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The work content of non-equilibrium systems in relation to a heat bath is often analyzed in 
terms of expectation values of an underlying random work variable. However, we show that when 
optimizing the expectation value of the extracted work, the resulting extraction process is subject 
to intrinsic fluctuations. These fluctuations can be of the same order as the expected work content 
per se, in which case the extracted energy is unpredictable, thus intuitively more heat-like than 
work-like. This raises the question of the 'truly' work-like energy that can extracted. Here we 
consider an alternative that corresponds to an essentially fluctuation-free extraction. We show that 
this quantity can be expressed in terms of a non-equilibrium generalization of the free energy, or 
equivalently in terms of a one-shot relative entropy measure introduced in information theory. 



Introduction.- How much useful energy can be har- 
vested by equilibrating a system with respect to an en- 
vironment of temperature T? This seemingly innocent 
question has spurred a considerable literature, especially 
in relation to Maxwell's demon and Landauer's principle 
(for overviews see Intuitively, we wish to extract 

ordered and predictable energy, i.e., 'work', as opposed 
to disordered low quality energy in the form of 'heat'. 
Here we address the question of whether there exists a 
quantitative notion of work content that truly reflects 
the idea of work as ordered energy. The catch is that 
in statistical models the work yield (or cost) of a given 
transformation is typically a random variable, i.e., each 
time we perform the operation, the observed work may 
take a different value. (This is maybe most clearly dis- 
played in the context of fluctuation theorems [5].) The 
work extraction problem, and the closely related question 
of the work cost of information erasure (Landauer's prin- 
ciple) , is often analyzed in terms of the expectation value 
of the underlying random work variable (see, e.g., [SHE]). 
However, we find that when optimizing the expectation 
value of the extracted work, the resulting work extrac- 
tion process has an intrinsic randomness determined by 
the initial non-equilibrium distribution of the system and 
the Hamiltonian. Although these fluctuations are 'small' 
in many realistic scenarios, they can, as we shall see, be 
large in the general case. Moreover, with increasing sys- 
tem size, these fluctuations can grow at the same order as 
the expected work content. A process that optimizes the 
expectation value of the extracted energy may thus not 
act as an ordered and predictable energy source. Another 
way to put this is to say that the extracted energy be- 
comes more heat-like than work-like. Here, we consider 
an alternative, the e- deterministic work content, which 
quantifies the maximal amount of energy that can be ex- 
tracted if we demand to always get precisely this energy 
(neither more nor less) each single time we run the ex- 
traction process, apart from a small probability of failure 
e. This quantity formalizes the idea of an almost per- 
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fectly ordered energy source. 

Similarly to jH [TOj, we here analyze work extraction 
and information erasure in a one-shot setting, i.e., we 
characterize single runs of a device. However, in contrast 
to [TU] , we here allow the systems to have non-trivial 
Hamiltonians, and prove near-optimality within the class 
of physical models we employ. Similar results have inde- 
pendently been obtained for a different type of setting in 

puna. 

The model. - We formalize the main assumptions of this 
investigation in terms of a simple class of models that de- 
fines the allowed physical operations and their resulting 
work cost. Akin to, e.g., 15111011131111], we assume that 
the system consists of a finite number of energy levels 
h := (hi, ■ ■ ■ , hisr). We can raise or lower these energy 
levels at will, which we refer to as level transformations 
(LT). (For a quantum system this would essentially cor- 
respond to adiabatic evolution with respect to some ex- 
ternal control parameters.) Via the LTs we define what 
work is in our model. The change of an occupied level n 
from h n to h' n results in a work gain h n — h' n (or work 
cost h' n — h n ). To model the thermalization of the sys- 
tem with respect to a heat bath of temperature T, the 
system is put into the Gibbs distribution with respect to 
the given set of energy levels h. More precisely, after the 
thermalization, the state is a given by a random variable 
N ', which is Gibbs distributed, i.e., P(N — n) = G n (h), 
where G n (h) := e~^ h " /Z(h), /3 := l/(kT), with k Boltz- 
mann's constant, and Z(h) := 53 e~^ hn is the partition 
function. An important assumption is that the state (re- 
garded as a random variable) after a thermalization is 
independent of the state before. For the work extraction 
(or information erasure) we allow arbitrary processes, 
meaning arbitrary finite sequences of LTs and thermal- 
izations at a fixed temperature. The random work yield 
(or cost) of such a process is given by the sum of the work 
yields of all its LTs. (For further details see Appendix 
[B]) In spite of the simplicity of this model, it allows us to 
re-derive known results concerning work extraction and 
information erasure in the expectation value setting. Fur- 
thermore, a version of Crook's fluctuation theorem [15] 
can be derived within this model, which plays an impor- 
tant role in the analysis. 
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Isothermal reversible processes.- Before we turn to the 
question of extractable work, we shall first make a brief 
observation concerning equilibrium transformations. The 
minimal expected work cost of transforming a system 
from one equilibrium configuration to another is given 
by the free energy difference between the final and initial 
Hamiltonian. The free-energy difference can furthermore 
be interpreted as an essentially deterministic work value. 
To see this, let h % := (h\, . . . ,h l N ) be an initial, h* := 
(h[, . . . , hf N ) a final set of energy levels, and let h(s) be 
a smooth path connecting these. We discretize this path 
into L steps as h! n :— h n (l/L). With step- wise LTs along 
the path, sandwiched by thermalizations, the resulting 
work cost is W — Yli^oihtft ~ where Af l is the 

state at the l-th step. As anticipated, lim£_ i . 00 (VL) = 
F(h f ) - F(h l ), where F(h) := -kTlnZJh) is the free 
energy. A similar calculation (Appendix [C]) making use 
of the independence of the work costs of the subsequent 
LTs, shows that lim L ^ 00 ((W 2 ) - (W) 2 ) = 0, i.e., the 
fluctuations around the average value vanish. Hence, we 
can interpret the free energy difference as an essentially 
deterministic work cost, rather than a mere expectation 
value. We refer to this type of limit process as an isother- 
mal reversible (ITR) process, which is understood to al- 
ways start (as well as end) in an equilibrium distribution. 

Expected work extraction.- Next we show that stan- 
dard results on the expected extractable work can be 
re-derived within our model. Given an initial non- 
equilibrium distribution q and an initial energy level con- 
figuration h, we ask for the best possible expected work 
yield that can be obtained if we are allowed to use any 
cyclic process that takes h back to h, and operates on the 
initial distribution q. Intuitively, to obtain the optimum 
we should try to avoid unnecessary dissipation when the 
system is put in contact with the heat bath. To this 
end, we first do a single LT that takes h to h', where 
h' n := — kTlnq n . This has the property that G(h') = q. 
We next perform an ITR that takes b! back to h. Com- 
bined, these two steps yield the expected work gain 

A(q,h)=kTln(2)D(q\\G(h)), (1) 

where D(q\\p) := g n log 2 g„ - £„<7„log 2 p„ is the 
relative Shannon entropy (Kullback-Leibler divergence) 
[16], and log 2 denotes the base 2 logarithm. The rel- 
ative entropy measures the difference between distribu- 
tions, and thus A(q, h) quantify how different the initial 
distribution is from the equilibrium distribution. (The 
relative entropy should not to be confused with the con- 
ditional Shannon/von Neumann entropy, as used in e.g. 
[10j . which emerges in settings where we have access to 
side-information.) Using the positivity of relative en- 
tropy, D(q\\p) > 0, it can be shown that A(q, h) is the 
largest expected work that can be extracted in our model 
(Appendix [d]). In a similar manner one can also derive 
the minimal expected work cost for information erasure 
to be C(q, h, s) = h s - F(h) - kT \n(2) D(q\\G{h)), where 
s is the energy level where we choose to put the sys- 
tem (Appendix |E|) . The quantity A(q, h) has been rec- 




FIG. 1: The e-free energy is defined as F e (q,h) := 
— fcTln Za* , where A* minimizes the truncated partition func- 
tion Za '■= S„gA e /3h " over au sufficiently likely subsets, 
q(A) := X^jgA 9j > 1 ~ e - F° r small e the e-deterministic 
work content in q with respect to the energy levels h is 
A £ (q, h) « F e (q, h) — F(h). This work yield is obtained by a 
three-step process: (a) A level transformation (LT) that lifts 
all energy levels not in A* to a very high value, (b) A ther- 
malization, resulting in the Gibbs distribution G(h'). (c) An 
isothermal reversible (ITR) process from h' back to h, which 
gives the essentially deterministic work yield F(h') — F(h). 
With a probability larger than 1 — e, the work yield of the 
total process is F e (q, h) — F{h). 

ognized in the literature [B1 fTTHT^] as the 'work content' 
of non-equilibrium systems, and we here refer to it as 
the expected work content. In the special case that the 
system is completely degenerate, h — (r, . . . ,r) for some 
constant r, the Gibbs state becomes maximally mixed, 
and Eq. ^ reduces to A(q, h) = [log 2 N - H(q)]kT\n2, 
where H(q) := — 5Z«=i In log 2 q n is the Shannon entropy 

Fluctuations in the optimal expected work extraction. - 
Equation gives us the optimal expected work yield, 
i.e., the best energy gain when averaged over many in- 
dependent repetitions of the extraction. The question is 
how much the random work yield of each single instance 
of this process typically deviates from this mean value. 
In other words, how large are the fluctuations? It turns 
out (Appendix [f]) that for any family of processes where 
the expected work yield converges to the maximum in 
Eq. ([I]), the resulting work yield variable must converge 
(in probability) to 

Wyidd := KThiqjsr - kT\nG N {h), (2) 

where N is the initial state of the system. Hence, the 
distribution of the fluctuations in the optimal expected 
work extraction is uniquely determined by the initial dis- 
tribution q and the energy levels h. As one already may 
suspect, and as we later will confirm, these fluctuations 
can be large compared to the average value, in which case 
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the optimal expected work extraction does not act as a 
truly ordered source of energy. 

e- deterministic work extraction.- Our primary goal is 
to characterize the e-deterministic work content of non- 
equilibrium systems. We thus need to specify what 'e- 
deterministic' is supposed to mean. We say that a ran- 
dom variable X has the (e, J)-deterministic value x, if 
the probability to find X in the interval [x — 8, x + S] 
is larger than 1 — e. Hence, 6 is the precision by which 
the value x is taken, and e the largest probability by 
which this fails. We define A$(q, h) as the highest pos- 
sible (e, <5)-dcterministic work yield among all processes 
that operate on the initial distribution q with initial and 
final energy levels h. We next define the e-deterministic 
work content as A e {q, h) := lim^o Ag(q, h), i.e., we take 
the limit of infinite precision, thus formalizing the idea 
of an energy extraction that is essentially free of fluctua- 
tions (Appendix [I]) . Our immediate goal is to determine 
A e (q, h) as precisely as we can, and we proceed by deter- 
mining lower and upper bounds. 

These bounds can be expressed in terms of what we 
refer to as the e-free energy. Given a subset A of the en- 
ergy levels, the truncated partition function is defined as 
Z^{h) := X^rieA e~P h ™ . Next, we minimize Z\(h) among 
all subsets A such that q(A) := J2neA In > 1 — £• If 
A* denotes such a minimizing set, then the e-free energy 
is defined as F e (q,h) := — fcTln Za* (h). The concept 
of one-shot free energy (and one-shot relative entropy) 
has been independently introduced in [11] to character- 
ize work extraction in a genuine quantum setting. 

To find a lower bound to Ag (q, h) we consider the fol- 
lowing process (see Fig. [I]). In the first step we lift all 
levels not in A* to a very high value. More precisely, we 
construct a new set of energy levels h! as h' n :— h n if 
n £ A*, while h' n :— h n + E if n ^ A*. Next, we ther- 
malize the system at the new energy level configuration 
hi , and perform an ITR back to h. With a probability 
larger than 1 — e the work cost of the total process is 
F(h) - F(h'). Furthermore, lim E _> +00 F(h') = F e (q,h). 
We can conclude that A e 5 (q, h) > F c (q, h) - F(h). 

The question is if we can find a process that extracts 
more work. It turns out that this lower bound is close to 
the optimal value if e and S are small. We can prove the 
upper bound A\{q, h) < F e (q,h)-F(h)-kTln(l-e)+65 
by combining a bound on the work yield of a single initial 
LT, and a variation on the theme of Crook's fluctuation 
theorem (Appendix [j} . In the limit of infinite precision, 
5 — > 0, we thus find that the e-deterministic work content 
A e (q, h) can be bounded as 

< AHq, h) - F e {q, h) + F(h) < -JfeTln(l - e). (3) 

Note that — fcTln(l — e) is an upper bound to the e- 
deterministic work content of equilibrium distributions. 
(Fluctuation theorems allow 'violations' of the macro- 
scopic second law with an exponentially small probabil- 
ity [5].) Loosely speaking, we have thus determined the 
value of A e (q, h) up to an error with the size of a suffi- 
ciently probable thermal equilibrium fluctuation. 



In the expectation value setting we have seen that 
the extractable work can be expressed in term of a rel- 
ative entropy. The above result can be reformulated 
in a similar spirit. The relative Renyi 0-entropy be- 
tween two distributions q and p is defined as, Do(q\\p) = 

— log 2 ^2j. q >oPj> where we only sum p over the sup- 
port of q. We can now obtain an e-smoothed rela- 
tive Renyi 0-entropy in a manner very similar to how 
we defined the truncated partition function: we sum 
p over the best sufficiently likely support, Dq(<7||p) = 

— log 2 rnin g (A)>i-e Ylje\Pj '■ This smoothed relative en- 
tropy was (up to some technical differences) introduced 
in [50] for the characterization of one-shot bounds on 
channel coding. (See also [51] [55] f° r quantum versions.) 
A comparison with the e-free energy yields 



F e (g, h) - F(h) = kTln(2)D* (q\\G(h)). 



(4) 



Hence, the generalized free energy difference can be 
rephrased in terms of how different the initial distribu- 
tion is from the equilibrium distribution, as measured by 
the relative entropy Dq. 

In the special case of a completely degenerate 
set of energy levels the work content reduces to 
A e (q,h) fa fcTlog 2 iV — feTlog 2 mmp(A)>i- e |A|, where 
log 2 minp(A) >1 _ c |A| can be regarded as a smoothed 
Renyi 0-entropy. This is in essence the same as obtained 
in 0. 

An immediate question is how the expected work con- 
tent compares with the e-deterministic work content. In 
the following we consider some simple examples, where 
we also compare the expected work content with the size 
of the fluctuations in the expected work extraction. For 
the latter we use the random work yield Wyidd as de- 
fined by Eq. ([2]), and measure the size of the fluctua- 
tions in terms of the standard deviation o^Wyioid) := 

«^ y 2 icid> - <ww 2 ) 1/2 . 

Independent, identical, and non-interacting systems. - 
Consider a large collection of m identical and non- 
interacting systems. The initial distribution is a product 
distribution q{n\) ■ ■ ■ q(n m ) (denoted q® m ) and we as- 
sume that each system has an identical set of energy lev- 
els, in total h(ni, . . . , n m ) — h(ni) + - ■ ■ + h(n m ) (denoted 
h® m ). The latter yields a product Gibbs distribution 
G(h)® m . The expected work content of this system is 
A(q® m ,h® m ) = mA(q,h). Using Eq. Q a direct calcu- 
lation yields o-{W™ cM ) = y/mkT\a(2)a{q\\G{h)), where 

v(<l\\ r ) 2 ■= E„9n[ lo g2(W r «)] 2 - D(q\\r) 2 . As antic- 
ipated, the expected work content thus grows like m, 
while the fluctuations only grow like \fm. 

As one may suspect, the e-deterministic work content is 
to the leading order equal to the expected work content. 
The difference appears at the next to leading order. Via 
Berry-Esseen's theorem [23l [24] (which determines the 
convergence rate in the central limit theorem) it can be 
proved (Appendix |N 1| and |N~2) that 



A e (q* 



, h® m ) =mA(q, h) + V^ikT\n(2)^- 1 (e)a(q\\G(h)) 
+ o( v / to), 
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where o(y/m) is a correction term that grows slower than 
y/m, and is the inverse of the cumulative distribution 
function of the standard normal distribution. Hence, the 
smaller our error tolerance e, the more the correction 
term pushes down the e-deterministic work content as 
compared to the expected work content. That the work 
content per system approaches A(q, h) in the asymptotic 
iid limit, can alternatively be obtained as a special case of 
the asymptotic rate of interconversion of quantum states 
that was proved in |12j in a resource theory framework. 

Long range correlation - In the previous example the 
fluctuations in the expected work extraction are small in 
a relative sense. Here we consider a case where both the 
fluctuations and the expected work content grow linearly 
with the system size (Appendix N 3 1 . As in the previ- 



ous example, imagine a collection of m non-interacting 
systems, each with identical collection of energy levels 
h. For some e (independent of to) the system is pre- 
pared in the joint ground state 0, . . . , with probability 
1 — e, while with probability e it is prepared in the Gibbs 
distribution. The resulting distribution is qf 1 l — 
(1 - e)S h ---Si o + eG*! (h) ■ ■ ■ d (h). This "yields 
A(q m , h m j ~ -mfcTln(2)(l - e) log 2 G (h), a(W™ ld ) ~ 

-mkT ln(2) y/e(l-e) log 2 G (h), and A e {q m ,h m ) ~ 
—mkT\n(2)log 2 Go(h). Hence, all three quantities grow 
proportionally to to. 

Maximally mixed state distribution.- To obtain another 
example of large fluctuations, let the distribution q m be 
maximally mixed, i.e., q™ , = d~ m , for a collection of 



(i-level systems (Appendix N4). For large to we assume 
that the energy levels are dense enough that the discrete 
collection of levels can be replaced by a spectral density 
function. One example of such a density is Wigner's semi- 
circle law, where f( m \x) :— 2^/R(m) 2 — x 2 /[nR(m) 2 ] 
for |a;| < R(m) and zero otherwise. With R(m) := 
\[2d m l 2 this yields the asymptotic energy level distribu- 
tion of large random matrices from the Gaussian unitary 
ensemble [25]. For the semi-circle distribution it turns 
out that A(q m ,h m ) ~ R(m), cr(W™ cld ) ~ R(m)/2, and 
A e (q m ,h m ) ~ c(e)R(m), where c(e) does not depend on 

TO. 



Conclusions.- In [S] it was argued that the extractable 
work is generally not related to the Shannon entropy, 
but rather to one-shot entropies. We here reach a similar 
conclusion, albeit from a different angle. The expected 
work content is always related to the (relative) Shannon 
entropy, irrespective of the initial distribution or choice of 
energy levels. However, the expected work content does 
not necessarily correspond to a truly predictable energy 
source. The e-deterministic work content, however, does 
correspond to the almost perfectly ordered energy that 
can be extracted, and can be expressed in terms of a one- 
shot relative entropy measure, which essentially reduces 
to the result of [§] in the case of completely degenerate 
energy levels. 

Since fluctuations is a crucial factor in our setting it 
is maybe not surprising that a fluctuation theorem plays 
a role in the derivations, which also suggests a deeper 
relation between fluctuation theorems, work-extraction, 
and one-shot information theory. 

We have here employed what one could refer to as a 
discrete classical model. A relevant question for future 
work is the extension of this one-shot analysis to a set- 
ting where we allow superpositions between energy eigen- 
states of different energies, and where the work-extractor 
furthermore can possess quantum information about the 
system [TO] , 

Such a quantum generalization is likely to benefit from 
an explicit treatment of the degrees of freedom that car- 
ries the extracted energy (e.g., in the spirit of [25]). This 
could also provide a better understanding of how to char- 
acterize the quality of the extracted work. On a more 
general level, an operational approach based on what 
'work' is supposed to achieve, rather than on ad hoc 
definitions, may yield a deeper answer to the question 
of the truly work-like energy content of non-equilibrium 
systems. 

The author thanks Lfdia del Rio for useful comments. 
This research was supported by the Swiss National Sci- 
ence Foundation through the National Centre of Compe- 
tence in Research 'Quantum Science and Technology'. 



Appendix A: Some remarks 

Here we make a few remarks concerning the overall 
structure and scope of this investigation. 

Although we put emphasis on the work extraction 
problem, we also treat the work cost of information era- 
sure. Moreover, rather than assuming that these pro- 
cesses begin and end in the very same collection of energy 
levels h, we allow an initial set of energy levels h % and fi- 
nal set of energy levels h* . This makes it easier to use 
these processes as building blocks in a composition of pro- 
cesses. For convenience, and to underline the similarities 



between work extraction and information erasure, we will 
often express the former in terms of its work cost rather 
than its work yield. For example, in Appendix [D] we 
introduce C extT (q, h*, h* ) as the minimal expected work 
cost of transforming the system from the set of energy 
levels h % to the new levels h/, assuming the initial state 
is distributed q. Hence, the expected work content, as 
introduced in the main text, is A(q, h) = —C cxtI (q, h, h). 

Section [5] introduces the model we employ, and defines 
the set of processes over which we optimize the work ex- 
traction or information erasure. To each such process is, 
by construction, associated a probability distribution of 
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possible work costs. To obtain a well denned optimiza- 
tion problem we must specify a cost function. The cost 
function is functional on the space of probability distri- 
butions. In other words, we assign a valued to the prob- 
ability distribution of work costs of the process, rather 
than to the particular outcome in each single run. (Fur- 
thermore, we do not strictly speaking minimize this cost 
function in the sense of finding a minimizing element, 
but we rather determine the infimum over all allowed 
processes.) Each choice of cost function potentially cor- 
responds to a different formalization of what 'work con- 
tent' is supposed to be. In this investigation we compare 
two cost functions: the expectation value and the (e, S)- 
deterministic value (to be defined in Appendix |G| . 

Work extraction, information erasure, as well as other 
transformations, are often analyzed in terms of expec- 
tation values, and limits on the cost of these operations 
are often expressed in terms of the expectation values 
[SHS1 EH In the quantum case, there are sev- 

eral investigations where work in some sense is expressed 
in terms of expectation values with respect to quantum 
states of the system (see, e.g., [TH |3"TH3"3"] L In these 
cases it is of course not clear to what extent one can 
(and whether one should) associate an underlying ran- 
dom work variable to the expectation value, unless ex- 
plicit measurements arc included in the model. We will 
not consider this issue here, but rather use an essentially 
discrete classical model, as detailed in Appendix [B| 

We consider the expectation value as cost function for 
work extraction in Appendix [Dj and for the information 
erasure in Appendix |EJ In Appendix [F] we prove that 
the optimal expected work extraction has an intrinsic 
randomness associated to it. 

Section [G] introduces the alternative cost function, the 
(e, (5)-deterministic value, which we apply to work extrac- 
tion in Appendix [IJ and erasure in Appendix |L) 

In Appendix |N| we compare the expected work content 
with the e-deterministic work content for some simple 
examples of systems. We also compare the expected work 
content with the fluctuations in processes that achieve 
the optimal expected work content. 

We end with Appendix [Oj where we make a brief com- 
ment on an alternative type of cost function, and its re- 
lation to the almost deterministic setting. 



Appendix B: The model 

The choice of model is a compromise between simplic- 
ity for a tractable optimization problem, and the need 
to capture some essential aspects of the effects of a heat 
bath. Similar types of models have bee considered in 

[a nni nu . 

We assume that the system can be in a finite set of 
states {1, . . . , N}, where TV is a fixed number. To each 
such state n we associate an energy level h n . In other 
words, the system can be found in any of the energy levels 
h = (hi, . . . , Un) € Mr. In general, we will view the 



state of the system as a random variable Af, with some 
probability distribution q — (q%, . . . , q^) e ¥(N). Here, 
Y(N) denotes the probability simplex over N objects 

F(N) := {( gi , . . . ,q N ) : q x , . . . ,q N > 0, £ q n = I}. 

n=l 

By P + (TV) we denote the subset of all distributions with 
full support, i.e., q n > for n = 1, . . . , N. 

The model moreover includes two elementary opera- 
tions that allow us to change the energy levels and the 
state of the system, respectively. The first type of oper- 
ation allows us to change the collection of energy lev- 
els h = (hi , . . . , /ijv) G R N into a new configuration 
h' = (h\, . . . , h' N ) € M N of our choice. We refer to this as 
a level transformation (LT). Note that we assume that an 
LT always transforms an element h £ M N to an element 
h' G K w . In particular, the underlying number of states 
does not change, and we do not allow 'infinite energies', 
like h n = +oo or h n = — oo. (The latter is not a particu- 
larly severe restriction as we can use limits to essentially 
the same effect.) The LTs do not affect the state of the 
system, and thus the random variable Af' describing the 
state after the LT is identical to the state Af before the 
transformation, i.e., Af' =Af. 

Via the LTs we furthermore define what 'work' is in 
this model. Given an LT that takes h to h' , operating on 
the initial state Af, we define the work cost as 

W := h' u - V. (Bl) 

We refer to — W as the work yield or work gain. 

The second elementary operation changes the state of 
the system, and models the thermalization by a heat bath 
of temperature T. We will throughout this investigation 
assume that this temperature is fixed and given. The 
thermalization does not change the energy levels h, but 
replaces the state Af, with a new independent random 
variable Af' that is Gibbs distributed with respect to h, 
i.e., 

P(Af' = n) =G n (h), (B2) 

where 

v 1 n—l 

and where k is Boltzmann's constant. We denote G(h) := 
(Gi(h), . . . , Gat(/i)). That N' is 'independent' is to be 
understood such that if we make a sequence of thermal- 
izations, the resulting family of random variables are all 
independent of each other and of the initial state. The 
thermalization has no work cost. 

This way to model the effect of a heat bath is a special 
case of the detailed balance condition as employed, e.g., 
in [13] for a derivation of the Jarzynski equality, or in 
[S] for Landauer's principle. While the detailed balance 
condition allows a partial or gradual thermalization of 
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the system, our model is somewhat more brutal in that 
it directly puts the entire system in the Gibbs state. 

When we speak of a process V we mean a finite se- 
quence of LTs and thermalizations (at one fixed temper- 
ature T) . The work cost of a process V is defined as the 
sum of the work costs of all the LTs in the process. We 
denote work cost of a process V as W(P, Af), where Af is 
the initial state. We let fPfJi 1 ,^) denote the collection 
of all processes that starts in the energy levels h % and 
ends with the energy levels ft/. 

Note that the work cost of two LTs are independent 
only if they are separated by a thermalization. Since two 
consecutive LT processes can be combined into one sin- 
gle (adding their work costs), and since two consecutive 
thermalizations have the same effect as one single, we 
may without loss of generality regard every process in 
£?{h % ,\v) as an alternating sequence of thermalizations 
and LTs. If the system initially is in state Af, with distri- 
bution q, and if h° , . . . , h L is the sequence of energy level 
configurations, we may thus in general write the work 
cost of the process as 



L-1 



(B3) 



1=0 



where each Afi is an independent random variable. Here 
TVo := Af, and Afi is Gibbs distributed G(h l ) for each 
I ^ 0. 

We let J-(V,Af) denote the final state of the process 
V € 3P(h l , h,f) that operates on the initial state Af. Note 
that F(fP,N) depends on Af only in the case that V does 
not contain any thermalization, due to the assumed inde- 
pendence of subsequent states separated by thermaliza- 
tions. In the case that V does contain a thermalization, 
then fF(fP,Af) is distributed according to Gibbs distribu- 
tion of the last thermalization in the process. 

As suggested by our use of phrases such as 'energy 
levels' the most immediate interpretation of this model 
in more physical terms would be of a quantum system. 
The LTs would then correspond to adiabatic passage. By 
this we intend Hamiltonian evolution as a closed quan- 
tum system, where the Hamiltonian depends on external 
parameters (e.g, classical fields) that we change on much 
slower slower rate than the characteristic time-scales of 
the Hamiltonian. (We may need to take some extra care 
at possible level crossings.) 

Note that our model corresponds to the case that the 
initial density operator of the system is diagonal in an 
energy eigenbasis. (Strictly speaking, we should also in- 
clude an energy measurement to obtain a random vari- 
able from the underlying quantum state at each LT. How- 
ever, as the state already is assumed to be diagonal in the 
energy eigenbasis, this is more of a technicality.) Hence, 
even though our model indeed can be phrased in terms 
of a quantum system, it in essence is a classical discrete 
model, as we do not consider superpositions of energy 
levels or quantum correlations with a reference system 



The application of the thermalization operation corre- 
sponds to turning on and off an interaction between the 
system and a heat bath. We here imagine that this hap- 
pens on a time-scale much larger than the time-scale of 
thermalization and all other relevant time-scales. 



Appendix C: Isothermal reversible processes 

Isothermal reversible process takes an equilibrium con- 
figuration to another, where the work cost is given by 
the free energy difference of the final and initial system. 
These processes are generally quasi-static (i.e., at each 
point along the process, the system is essentially in equi- 
librium with the heat bath) . Here we consider the coun- 
terpart of this in our model, which will serve as an im- 
portant building block in the rest of this investigation. 

Given an initial configuration of energy levels h l and 
a final set of energy levels h* we consider a path in the 
space of energy level configurations along which we move 
by incremental steps of LT processes sandwiched between 
thermalizations. In the limit of infinitely small steps we 
find that the expected work cost converges toward the 
free energy difference of the final and initial energy con- 
figuration. However, by an argument very similar to the 
weak law of large numbers, we make the observation that 
the work cost essentially becomes deterministic. 

Consider a bounded and sufficiently smooth path h : 
[0,1] R N , such that h(0) := h l and h(l) := h* . We 
make an L-step discretization of this path, as h(lAx), 
for I = 0, . ..,L — 1, where Ax = 1/L. Given this dis- 
cretization, we construct a process P' 1 ' that consists of 
the sequence of LTs that takes h(lAx) to h((l + l)Ax), 
intersected with thermalizations. The work cost of the 
process is 



L-1 



W{V^ L \No) = l h MV + - h K (lAx)} , 

i=o 

(CI) 

where Afi is the state of the system at the l-th step, which 
has distribution G(h(lAx)). 
If we define 

;= h n ((l + l)Ax) - h n (lAx) ^ 
Ax 

one can see that the expectation value of the work cost 
is 

L-1 N 

(W(V w ,Af )) = E E &h n (l)G n (h(lAx))Ax 

1=0 n=l 
"1 dhn e ~0h n ( X ) 



L — y oc 
— > 



E 



where 



o Tf^i dx Z ( h (x)) 
=F{hf)-F{K l ) 1 

F(h) = -kT\nZ{h) 



dx 



(C3) 



(C4) 
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denotes the free energy of h. 

By using the assumed independence of the 
state variables Afi, we can calculate the variance 
a(W(V^,Af )) 2 := (W(VW,Mo) 2 ) - (W(V^ L \ M,)) 2 , 
which yields 

a(W(V^ L \Af )) 2 



L-l N 



^^[Mi n {l)YG n {h{lkx))&2 



1=0 n=l 
L-l 



(C5) 



z=o 



N 
n=l 



Ax 2 . 



Assuming the function h to be bounded and sufficiently 
smooth, one can see that cr{W{V^ L \Mgj) tends to zero 
as L — s- oo. By combining this with Eq. ( C3 ), and Cheby- 
shev's inequality (see e.g. 



lim P(\W(T {L \Afo) 



34]), it follows that 
F{h f ) + F{h l )\ >6) =0, 



for all 5 > 0. In other words, W(P {L \ Af ) converges 
in probability [33] to the free energy difference. We can 
conclude that ITR processes yield an essentially deter- 
ministic work cost. 

By the above discussion we can conclude the following 
Lemma: 

Lemma 1. Let h l , h* £ R. and let AT be a random vari- 
able which is distributed G(h l ). Let 6 > and < e < 1. 
Then there exists a process V £ &>(h\h f ) such that 

P(\W(V,Af) - F(h f ) + F(h l )\ <5)>l-e. (C6) 

In a terminology that we shall introduce later, this 
lemma states that for every e and 6, there exists a process 
V for which F{hl)-F{h l ) is an (e, <5)-deterministic value 
of the random variable W(V,Af). 



Appendix D: Optimal expected work extraction 

We shall here derive the minimal expected work cost 
(and thus the maximal expected work yield) of any pro- 
cess that transforms an energy level configuration h 1 into 
h\ with the state of the system initially distributed as 
q. (We make no restrictions on the final state, nor its 
distribution.) In other words, we use the expectation 
value as a cost function, and we search over all elements 
F m 0>(h\h f ) in order to minimize (W(V, A/")), where 
the initial state J\f is distributed q. The resulting infi- 
mum can be expressed in terms of the relative Shannon 
entropy [16] (also called the Kullback Liebler divergence 



J 



D (g\\p) : = Y qn log2 qn ~ ^2 qn lnp "' ( D1 ) 



which in some sense measures the difference between two 
probability distributions g,p£ ¥(N). Here, log 2 denotes 
the base-2 logarithm. 



Definition 1. Let h l ,hf £ WL N , and let Af be a random 
variable with distribution q € ¥(N), then we define 

C cxtr (q,h\h f ):= inf (W(V,Af)}. (D2) 

ve&>(h\hf) 

and in the special case h := h % — W we define the ex- 
pected work content as 



A(q,h) :=-C cxtI {q,h,h) 



= sup (-W(V,M))- 

V£3»(h\hf) 



(D3) 



Proposition 1. Let h\h s eR N , and let q £ ¥(N), then 
C cxtr (g, h\ h f ) =F{h f ) - F(h z ) 



kT\n(2)D(q\\G{h 1 )). 



(D4) 



Note that since h l £ R N it follows that G{ti) has full 
support, i.e., there is no n for which G n {h l ) — 0. Hence, 
D(q\\G(h 1 )) < +oo. 

A direct corollary of Proposition [T] is 



A(q,h) = kTln(2)D(q\\G(h)). 



(D5) 



Within our model we can thus re-derive this well known 
result concerning the work content of non-equilibrium 
systems 0H7HIH]- 

As a side remark we note that the quantity 



F(q,h) :=F(h) + ^H2)D(q\\G(h)) 

1 N 
-H2)H{q) + Y^K 



(D6) 



n=l 



can be viewed as a non-equilibrium generalization of the 
free energy. (It is not uncommon to refer to this more 
general quantity as 'free energy'. However, in this inves- 
tigation we reserve the term 'free energy' for the equilib- 
rium quantity F(h) = — kThiZ(h).) 



proof of Proposition [7J We first shall show that 

(W(V,AT)) >F(h f )-F(h l ) 

- kT \n(2) D(q\\G(h 1 )), 

for all V £ ^(h 1 ,^), where Af has distribution q. Define 



(D7) 



W := F(h f ) - F(h l ) - fcTln 



ON 



(D8) 



One can see that 



(W) = F(h f ) - F(h l ) - kT\n(2)D(q\\G(h 1 )). (D9) 

Next, let V £ ,^(h l ,h f ). Without loss of generality we 
may assume that this is a sequence of alternating LTs 
and thermalizations, beginning with an LT. Hence, we 
have a sequence of sets of energy levels h°, h 1 , . . . , h L , 
where h° := b? and h L := h f . The process proceeds 
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with an LT that takes h l to h +l , operating on the state 
Ni, followed by a thermalization, resulting in the new 
state A/j+i which is distributed G(h l+1 ). Furthermore 
No '■= N . The work cost of this process is 



W(V,N) = hb-h<h+^ (h% x -h l Mi ). i D I ( i ) 

If we now make use of the general relation 



L-l 

£< 

1=1 



F(h)- -\nG n (h), 



(Dll) 



in combination with Eqs. (D8) and ( |D10 ) the result is 

(D12) 



W{V,N)~W =^\nq M -^XnGMih 1 ) 



L-l 



|X;(lnG M (fc')-lnG! M (/i , + 1 ; 



P 



1=1 



Hence, 
(W(V,N)-W) 



P 



D{q\\G(h 1 )) 



L-l 



i£l>(G(fc , )||G(fc'+ 1 )). 



(D13) 



P 



i=i 



Due to the fact that the relative Shannon entropy is non- 
negative, D(p\\r) > 0, we thus find (W(P,N)) > (FT"). 
Combined with Eq. ([D9]) this yields Eq. (|D7|. 



Next we show that there exists a sequence of processes 
(V m ) m eN with V m & & \h\W f ) , such that 



lim (W(V m ,N)) =F(hf)-F(h l ) 



kTln(2)D(q\\G{h i )). 



(D14) 



For each m E N, we define h' n := —kTlnq n for all n 

such that q n ^ 0, and h' n := m otherwise. Let Vm be 
the LT that takes h l to h' . This process has the expected 

work cost (W(V£\N)) = kT\n{2)H(q)-J2 n q n hi l . The 
free energy of ti is F(h') = -fcTln(l + N e-' 3m ) 1 where 
Nq is the number of energy levels for which the initial 
distribution assigns zero probability, qk = 0. After the 
initial LT the system is thermalizcd, leading to a new 
state A/"', distributed G(hf). By Lemma fl] there exists a 

(2) f 

finite process ?i, that takes h to h* , and is such that 

\{W{V$,N')) - F{hf) + F(h')\ < 1/m, where N' is 
distributed G(h'). We let V m be the concatenation of the 

initial LT Vm\ the thermalization, and Vm' '• One can 



see (e.g., using Eq. (D6|) that lim„ 
F(h f ) - F{ti) - /cTln2L>(g||G(/i i )). 



>{W{V m ,N)) 



□ 



Appendix E: Minimal expected work cost of erasure 

To erase a system is to put it in a well defined and 
pre-determined state. In our model this corresponds to 



transforming the system into a specific selected state s € 
{1, . . . , N}. According to Landauer's erasure principle 
[IHH IM1 EI] there is a minimal work cost associated with 
this erasure. We shall here re-derive the 'standard' work 
cost of erasure, via the the expectation value as a cost 
function. 

Similarly as for the work extraction, we assume initial 
energy levels h 1 , final levels , and an initial state N 
with distribution q. However, in addition we require the 
process to put the system into the selected state s. For- 
mulated like this, one realizes that the work extraction 
task and the information erasure task are closely related. 
The erasure problem is nothing but the work extraction 
setup, but with an added constraint on the final distri- 
bution of the state. 

It is a bit too strict to demand that the erasure process 
puts the system in state s with certainty. Such a process 
exists within our model only if the initial distribution is 
Qn = $n,s- The reason for this is that the only method by 
which we can change the state of the system is by ther- 
malizing it, in which case the system is put in the Gibbs 
distribution G(h) for some collection of energy levels h. 
However, there exists no h G such that G n {h) = S niS . 
For this reason we only require the process V to result in 
final states F{V,N) such that P(J r (7 ? , A/") = s) > 1-r, 
for r > 0. After the optimization we take the limit r 0. 
We formalize this idea in terms of the following set of op- 
erations: 



Definition 2. Let h\h f € 



id let N be distributed 



q e V(N), let s € {1,...,N}, and < r < 1. Defil 
&>I(q,h\hf) 

:= {V £ &{h\ h f ) : P(F{V,N) = s) > 1 - r}. 



(El) 



The set 3P r s (q, h % , h*) depends on the initial distribu- 
tion q only in a very weak sense. The only aspect of 
q that matters is if q n — S ns , or not. For the sake of 
completeness we nevertheless keep q in the notation. 

Definition 3. Let h\h f € R N , q E F(N), and s E 
{1, ...,N}. Let N be a random variable that is dis- 
tributed q. Then we define 

C c ™ sc (q,h l ,h f ,s) := lim inf (W(V,N)). 

(E2) 

Note that r > r' > implies ^(q,h\h f ) D 
^j'iq, h\h f ). This in turn yields 

inf (W(V,N))< inf (WCP,N)}. 

In other words, for decreasing r the function 
mfp e5 ar( 9 .hi.^/)(W('P, N)) increases monotonically. 
Hence, the limit r — > in Eq. (E2| is well defined 
(possibly with the value +00). 
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Proposition 2. Let h\h f G R N and q G F(N), and 
s G {1, . . .,N}. Then 



C clasc (q,h\h f ,s) =hi-F{h l ) 
1 



P 



\n(2)D(q\\G(V)). 



(E3) 



In the special case of h := h l = h* for a completely 
degenerate set of energy levels, h n := r, we find the ex- 
pected work cost of erasure to be 



C crasc (q,h,h,s) = kT\n(2)H{q), 



(E4) 



which is a standard result concerning Landauer's erasure 
principle [H El GH ESI [39] . 

proof of Proposition [1| Regarding the erasure process as 
an alternating sequence of LTs and thcrmalizations, we 
first distinguish the special case that the process does not 
contain any thermalization. In this case the process only 
consists of one single LT. This LT must transform h % to 
bf . Furthermore, an LT does not change the state of the 
system. Hence, for this LT to be an admissible process it 
follows that the initial distribution q must be such that 
q s > 1 — r. Hence, in the limit t — > we can only 
accept the initial distribution q n = S sn . In this l imit , the 
resulting energy cost, h{ — h\, agrees with Eq. (E3). 

We next consider the case that the process V G 
^s(q, h?, h*) does contain at least one thermalization. 
Denote R := h{ - F{ti) - kTln(2)D(q\\G(ti)). First 
we shall prove that the left hand side of Eq. ( |E3| is 
lower bounded by R. Let us divide V into two parts: 
The first part, Pi, is the whole process up to the very 
last thermalization. We let h be the configuration of 
energy levels at this final thermalization. The second 
part, 7^2, consists only of the final LT that transforms h 
into h f . By Proposition [l] we know that (W(Vi,Af)) > 
F(h) - F(h l ) - kT ln(2) D[q\\G(h 1 )). The expected work 
cost of V 2 is (W(V 2 , Af)) = (hL - hjj-), where the state 
Af is Gibbs distributed G(h). By combining the above 
observations we find 

(W(V,Af)) = (WiVuAf)) + (W(V 2 ,Jf)) 

> F(h)-F{V)- X ^D(q\\G(K)) 



+K) - (hjr) 



(E5) 



Since V G ^ T s {q,h\h f ) we must have G s (h) > 
1 — r. It follows that lim T ^o(^^-) = h{. Fur- 
thermore, F(h) - (h^} = ~kT\n(2)H(G(h)), which 
goes to zero as r —> 0. We can conclude that 
lim T ^omi Pe ^r (q ^ij lf} (W(T l ,Af)) > R. 

Next we shall find a sequence of processes V m 
such that lim m _ s . 00 P(J r (7 : ' m , M) = s) = 1, and 
lim m _ >00 (H / (P m , A/")) = R. Together with the lower 
bound we proved above, this implies Eq. (E3|. We con- 
struct each V m as a concatenation of an initial LT T J ^ 1 \ 
a thermalization, a process , and a final LT V$ . 



We begin by constructing as the LT that takes 
h % to a configuration of energy levels h! . The latter we 
define as h' n := —(\nq n )/(3 for all n such that g n ^ 0, 
and h' n — m otherwise. The expected work cost of this 

process acting on the initial state Af is (W(Pm\N)) = 
E n Qn(h' n - K) - -F{h % ) - kTln(2)D(q\\G(V)). 

Next, the system is thermalized, and we let Af' denote 
the state of the system after this thermalization. Define 
h" n :— —mS ntS + yJ n . By Lemma [l] there exists a process 

Pi 2) G 9Hh',h") such that \{W{V$ , M')) - F{h") + 
F(h')\ < l/m. Note that F(h') = -fcTln(l + N Qe -^ m ), 
where Nq is the number of energy levels k for which q^ = 
0. The final state of process vH ] is Af" := F{V$ , Af'), 
which is Gibbs distributed G(h"). 

Finally, we let V™ be the LT that takes h" to h s . This 
process has the expected work cost (W(Vm ,Af")) = 
mG s (h"). 

Combining the above results we find {(W^m, Af)) — 
R\ = \ (W(Vm\Af')) - h(+mG s (h")\ < m- 1 + \F(h") - 
F(h') — hi + mG s (h")\. By writing out the terms explic- 
itly, and using lim m _ i . 00 m[l — G s (h")] = 0, one can show 
that the right hand side of the above inequality converges 
to zero as m — y oo . Furthermore, P(J-(V m ,Af) = s) = 
G s {h"). Since lim m _ J . 00 G s {h") = 1, the proposition is 
proved. □ 



Appendix F: Intrinsic fluctuations in the optimal 
expected work extraction 

Here we show that for any sequence of processes for 
which the expected work cost approaches the minimal 
value, as given by Proposition [l] the resulting work cost 
variable converges in probability to a specific function of 
the initial state. 

Given a real valued random variable X, the cumulative 
distribution function is defined as Fx{x) := P(X < x). 
The moment generating function of X, if it exists, is de- 
fined as M x (t) := (e tx ) = e tx dF x (x). 

Given a random variable X and a sequence of random 
variables Xk, a well known result by Curtis [40 states 
that if the moment generating function Mx k (x) exists 
and converges pointwise to Mx{x) in a neighborhood of 
along the real axis, then Xk converge to X in distribu- 
tion, i.e., Fx k (x) converges to Fx (x) for each x where Fx 
is continuous. This standard result is unfortunately not 
quite enough for our purpose. We need a generalization 
[4"T1 W2\ where the interval does not contain 0. 

Proposition 3 (gUEE]). Let < a < b. Lf 

lim M Xk (x) = M x {x), Vx G (a, b), (Fl) 



then 



lim F Xk (x) = F x (x), 

k—too 



(F2) 



for each x where Fx is continuous. 
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Recall that a sequence of random variables Xk con- 
verges to X in probability, if for each S > it is true that 
hnifc^oo P(\X k - X\ > 5) = [33]. 

Given distributions q £ P(JV) and r £ ¥ + (N) and a 
real number a>0, a/1 the relative Renyi a-entropy 
is defined as 03] 



Hence, lim m _>. 00 a m — 0. Furthermore, by Eqs. (D9) and 



1 - Q a 



r ■ 

3 = 1 3 



(F3) 



Furthermore, we can let Di(q\\r) := D(q\\r), since 
lim Q _>i D a (q\\r) = Di(q\\r) @3J. It is further- 
more the case that lim Q ^ + D a (q\\r) = Do(q\\r) :— 
>o r n [44] . The quantity D a (q\\r) is non- 
decreasing in a, and furthermore non-negative, 



0<£>a(g||r)<I>/j(<z||r) ) 0<a</3. 



(F4) 



The latter can be seen by the fact that Dp can be ex- 
pressed in terms of the power mean (also called Holder 
mean). If w £ ¥(N), and x = (xx,...,xn) and 
s =/= 0, then the power mean is defined as M s (w, x) :— 
(ilk w kXk) 1,s 03- Furthermore, M (w,x) := UkX^ k . 
One can see that D a (q\\r) = log 2 M„_i(g, q/r), where 
(q/r) n := q n jr n . Since the power mean is monotonically 
increasing in s 45 , Eq. (F4) follows. 



Proposition 4. Let h l ,h,f £ M. N , and let AT be a random 
variable with distribution q £ ¥(N). If (V m )meN with 
V m £ ^{h\hf) is such that 



lim (W(V m ,Af)) =F(h f )-F(h i ) 

m— too 

- kTln(2)D(q\\G(h 1 )), 



(F5) 



then 



W(V m ,Af) -> F(hf) - F(h l ) - fcTln 
in probability. 

In the special case h := hf = h l , we thus find that the 
work yield, — W(V m , TV), converges in probability to 



W yicld (h,AT) := fcTln^ - kT\nG M {h). 
Proof. In the following we let 

W := F(h f ) - F(h l ) - kT 'In 



QjV 
G/\f(h i 



(F6) 



(F7) 



Let (7 , m )meN be any sequence in ^(h 1 ,^) such 
that lim m ^ 00 (VF(7' m ,AA)) = F(h*) - F{h l ) - 
kT\n{2)D{q\\G{h 1 )). Define 



--/3{W{V m ,Af) 
- (3F{h f ) + f3F{h l 



H2)D(q\\G(V)). 



(D12) we know that 



a m =-D{q\\G(h m +)) 

1 L m -1 

+ p E D(G(h m > l )\\G(h m > l+1 )), 



i=i 



where, for each m, (fe"'')^ is the sequence of energy 
level configurations in V m . Define the random variable 

X m :=-p[W(V m ,Ar)-W]. (F8) 

It follows that the cumulant generating function of X m 
is 

log 2 M Xm {t)=-W 1 - t (q\\G(h m > 1 )) 

-tY / D 1 _ t (G(h m > l )\\G(h m < l + 1 )), 
i=i 

where we know that Mx m (t) exists, since X m only can 
take a finite number of values for each m. By the mono- 
tonic increase of D a with respect to a (Eq. ( |F4| ), and 
D n > 0, it follows that 



> log 2 M Xm (t) > -ta m , V< £ (0, 1). (F9) 



Thus 



lim M Xm {t) = 1, Vi £ (0, 1). (F10) 



The constant X = has the moment generating func- 
tion Mx{t) = 1. Hence, according to Proposition [3j 
Eq. (F10) implies that X n converges in distribution to 



X. Since the cumulative distribution function of X is 
the step function, the convergence in distribution yields 

lim P(X m <*) = {?' X < °' (Fll) 

(We do not care about x — as it is a po int of disconti- 
nuity.) A direct consequence of Eq. (Fill is 



lim P{\W{V m ,N) -W\> 5) =0, Vd > 0. 

m— >oo 

In other words, W(V m ,Af) converges in probability to 
W. □ 



Appendix G: (e, <5)-deterministic values 

Here we construct a cost function that favors work cost 
variables that have a sufficiently narrow distribution, i.e, 
for which we are more or less certain of what the work 
cost will be. 
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Definition 4. Given a real-valued random variable X , 
and real numbers < e < 1 and < 8, we say that x € R 
is an (e, 8) -deterministic value of X if P(\X — x\ < 8) > 
1 — e. We denote the set of all (e, 8) -deterministic values 
of X as 

Ag(X) := {x £ R : P(|Z - z| < 8) > 1 - e}. (Gl) 

Note that it may very well be the case X does not 
have any (e, <5)-deterministic value, or that it has more 
than one (e, 5)-deterministic value. 

As we apply this concept, the random variable X 
will typically be the work cost of a given process, 
i.e., W(V,N). The set A e s (W(V,N)) corresponds to 
work values around which the distribution is sufficiently 
peaked. Since our goal is to find the minimal work 
cost, we select the 'smallest' of these sufficiently con- 
centrated work costs, or more precisely, the infimum 
MA e s (W{V,Af)). The quantity infAf(X) will serve 
as the cost function that defines what, e.g., (e, 
deterministic work content is (Appendix M. It is maybe 
worth pointing out that inf Ag(W(V, Af)) is only the cost 
of one fixed process V . To obtain the cost of extraction 
and information erasure we still need to minimize over 
the set of allowed processes. 

In the following we establish some properties of the 
quantity vniA\{X) that will prove useful in the subse- 
quent derivations. 

We first note that infA^(X) = +oo if and only if 
A\(X) = 0. With the assumptions < e < 1 and < 8 
it follows that — oo < miA$(X). 

The following two lemmas show that infA^(X) is de- 
creases monotonically with increasing e and 8. 

Lemma 2. Let X be a real-valued random variable, and 
let e, e' , and 8 be real numbers such that < e < e' < 1, 
and < 8, then 



and thus 



AKX) C A^ (X), 



infA^(X) > infA^ (X). 



(G2) 



(G3) 



Proof. If infAf(X) — +oo the Lemma is trivially true. 
Hence, without loss of generality we assume inf A e s (X) < 
+oc, and thus A e s (X) is non-empty. If x £ Ag(X), then 
P(\X - x\ < 8) > 1 - e. Since e < e', this implies 
P(\X - x\ < 8) > 1 - e', and thus Eq. ([G2]) holds 
immediately implies Eq. ( G3 1 . 



This 
□ 



Lemma 3. Let X be a real-valued random variable, and 
let e, 8, and 8' be real numbers such that < e < 1, and 
0<S <S', then 



and thus 



Af(X)CAf,(X), 



w£A e s (X) > mfA £ s ,(X). 



(G4) 



(G5) 



Proof. If infA^(X) = +oo, the lemma is trivially true. 
We thus assume infA|(X) < +oo, and hence Ag(X) is 
non-empty. If x € A|(X), then P(\X - x\ < 8) > 1 - e. 
Since < 8 < 8' it follows that P(\X-x\ < 8') > P(\X~ 
x\ < 8) for every iff. From this we can conclude that 
Eq. (G4) holds, which also proves Eq. (G5|. □ 



Lemma 4. Let X be a real valued random variable, and 
let e, 8 be real numbers such that < e < ^ and < 8. 
If there exists a real number x such that 



then 



P(\X-x\ <8)>l-e 



-28 < infA|(X) 



(G6) 



(G7) 



Proof. First note that Eq. (G6) implies A e s (X) ^ 0. Sup- 
pose there is an x' £ A e s (X) such that \x— x'\ > 28. It fol- 
lows that {z £ K : \z-x\ < 8}n{z £ K : \z-x'\ < 8} = 0. 
Hence, P{{z £ E : \z-x\ < 8}C\{z £ R : \z-x'\ < 8}) = 
P(\X - x\ < 8) + P(\X - x'\ < 8) > 2 - 2e = 1, which 
is a contradiction. Thus we must conclude \x — x'\ < 28. 
Since this is true for all x' £ A\(X) we can conclude that 
Eq. (lG7|) holds. □ 



Lemma 5. Let X and Y be two independent real-valued 
random variables, and let e and 8 be real numbers such 
that < e < 1 and < 8. Then 



AUX + Y)^ 



A e s (X) jt 0, Ag(Y) + 



Proof. The function Q(X,S) := sup sSR F(|X - s| < 8) 
is sometimes referred to as Levy's concentration function 
|46j . For two independent random variables X and Y it 
can be shown (see Lemma 1.11 in [15]) that 



Q(X + Y,8)< min[Q(X, 8),Q{Y, 8)} 



(G8) 



If we assume A| (X + Y ) ^ it implies that there exists 
azsuchthatP(|X + y-z| < 8) > 1-e. By Eq. ([G8| we 
can thus conclude that 1 — e < Q(X, 8). By the properties 
of the supremum, it follows that for every £ > there 
exists an x' such that Q(X,S) - £ < P{\X - x'\ < 8). 
Since 1 — e < Q(X, 8) it follows that we can find a £ > 0, 
and a corresponding x', such that 1 — e < Q(X, 8) — 
£ < P{\X - x'\ < 8). Thus, x' £ Afpf), and hence 
A|(X) ^ 0. By an equivalent argument A|(F) ^0. □ 

Lemma 6. Let X and Y be two independent real-valued 
random variables. Let e and 8 be real numbers such that 
< e < 1 - 4s and < 8. Then 

V 2 

infA|(X) + infA|(Y) - 48 < m£A e s (X + Y). (G9) 

Proof. First of all we note that the statement of the 
lemma is trivially true if inf A\(X + Y) = +oo. Thus, 
without loss of generality we assume infA^(Jf + Y) < 
+oo. By Lemma|5]this implies that that A € S (X) ^ and 
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A e 5 (Y) ^ 0. Thus there exist x G Af(Jf) and y € A|(y). 
Since X and Y are independent it follows that 

P(\X + Y-x-y\ < 28) 
> P(\X -x\< S)P(\Y -y\<S)>(l- e) 2 . 

Hence, x + y is an (2e — e 2 , 2i5)-deterministic value of 
X + Y. By assumption e < 1 — l/v2 and thus 2e — e 2 < 
1/2. Lemma [4] yields 



a: + V - AS < inf A 2 |p (X + Y) 



(G10) 



Since x G A|(X) it follows that infA|(X) < z, and 
similarly infA|(y) < y. Combined with Eq. (G10) this 
yields 

inf AfpsT) + inf AJ(F) - AS < inf A 2 ^ £ ' (X + Y). (Gil) 

Since 1 > 2e-e 2 > e > 0, Lemma ^yields infA 2 ;p 2 (A: + 
Y) < inf A^ S (X + Y). By LemmalSlwe furthermore find 
miA% 5 {X+Y) < vaiA%(X+Y). By combining Eq. ( |G"TT] ) 
with the above observations we obtain Eq. ( G9 ) . □ 



Appendix H: The e-free energy and the smoothed 
relative Renyi 0-entropy 

As we have seen in Appendix [Dj the minimal ex- 
pected work cost of the extraction process can be ex- 
pressed in terms of the generalized free energy F(q,h), 
or equivalently, the relative Shannon entropy. In the e- 
deterministic setting, the roles of these measures are, as 
we shall see in Appcndix|lJ taken over by two other quan- 
tities: the e-free energy and a smoothed relative Renyi 
0-entropy. 

Given a distribution q G P(AT), and an event A C 
{1, ...,N} we denote the probability of the the event 
A with respect to q as 



9(A) := 



(HI) 



Definition 5. Let h G R N and A C {1,...,N}. We 

define the truncated partition function with respect to A 
as 



Z A (h) 



(H2) 



Given < e < 1, and q G P(A^) we define the e-free 
energy as 

F e (q,h) := -lln inf Z A (h) (H3) 

P A:g(A)>l-e 

In other words, we make the free energy as large as 
possible by finding the smallest partition function trun- 
cated to a sufficiently likely event. Since the underlying 
set is finite, the infimum can be replaced by a minimum, 



i.e., there exists a sufficiently likely subset subset A* such 
that F e {q,h) = -kT\a.Z A *(h). 

The 'standard' relative Renyi 0-entropy (see e.g. [H]) 
between two distributions q and p over {1, . . . , A*"} is de- 
fined as 



Da{q\\p) ■= -log 2 Pi> 

j-1j>0 



(H4) 



where we sum p only over the support of q. We can obtain 
an e-smoothed relative Renyi 0-entropy in a manner very 
similar to how we defined the e-free energy; we sum p 
over the 'best' sufficiently likely support: 

Definition 6. Let q,pe F(N) and < e < 1. We define 
D§(g||p):=-bg 2 inf p(A). (H5) 

A:?(A)>l-e 

Up to some purely technical differences concerning the 
smoothing, this entropy measure was introduced in [20j . 
(See also [3TJ [S3] for related measures in the quantum 
setting.) 

The relative entropy Dq and the e-free energy are re- 
lated as 

F%q, h) = F(h) + i H2)D* (q\\G(h)). (H6) 

In what follows we shall switch freely between F e and Dq 
without comment. 

Lemma 7. Let h 6 M. N and let < e' < e < 1, and let 
q G P(N), then 



F' (q,h)<F*(q,h). 



(H7) 



Proof. Let A* C {1,...,A} be such that F e '(q,h) = 
-kT In Z A ,(h). Hence, q(A*) > 1 - e' > 1 - e. Thus, 
Z A *(h) > mi q{A)>1 _ e Z A (h). □ 

Lemma 8. Let h G R N , and q G P(A). TTien the func- 
tion e 1— > F e (q, h) is left- continuous on (0, 1]. 

Proof. Take an e € (0, 1]. We know that there exists a set 
A* C {1, . . . , N} such that F e (q,h) = -kT\nZ A ,(h). By 
definition q{ A*) > 1— e. Hence, there exists an e such that 
<?(A*) > 1 — e > 1 — e. As a consequence, A* is also a min- 
imizing set for F e (q,h), i.e., F e (q,h) = —kT\n Z A *(h). 
Moreover, this is true for all e G (1 — q(A*),e\. Hence, 
for each e there exists a left neighborhood to e, where 
F e (q,h) is constant. This proves the lemma. □ 

One may wonder why we have defined F e (q,h) as 

su P<z(A)>i-£ F A and not su P g (A)>i-e ^A> i- e -, wn Y a strict 
inequality rather than just an inequality? This is due to 
technicalities concerning the proofs of the upper bounds 
in Propositions [5] and [6| (via Lemmas [8} [l2"l and 15). This 
also the reason why we similarly define A e s in terms of a 
strict inequality. 
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Appendix I: Optimal e-deterministic work 
extraction 

In Sees. [D] and |E| we minimized the expectation value 
of the work cost variable for the given task. Instead of 
using the expectation value as the cost function, we here 
use the cost function inf A| introduced in Appendix [G] 
In other words, we demand that the random work cost 
variable, or work yield variable, have a very high degree 
of predictability. 

Definition 7. Let h\h s el" q G F(N), and let M 
be a random variable with distribution q. Let e,i £ R 
be such that < e < 1 and < 6 < +oo. Define the 
(e, 5) -deterministic cost of work extraction as 

C°f(q,h\hf):=M (J Al(W(V,Af)) 

Ve3»(h\hf) (Jj) 

inf m{A e s (W(V,N)). 

V<E&(h\hf) 

Furthermore, define the e-deterministic work cost of work 
extraction as 

Cf tr (<?, h\hf) := lim Cff (<?, h\ h*). (12) 

The two lines in Eq. ( pi] ) merely reflects the fact that 
it is a matter of convenience whether we wish to view 
the problem as finding the infimum of the set of all (e, 5)- 
deterministic values generated by all allowed processes, 
^Ve&>{h i ,ht) &g(W(V, A/")), or whether we wish to view 
it as a minimization of the cost function inf over the 
set of processes ^{h l ,h^). 

By combining the first line of Eq. |TT] ) in the above 
definition, with Eq. \G2\ in Lemma |2j and Eq. (G4| in 
Lemma [3j we obtain the following: 

Lemma 9. For fixed q e F(N), and h\h s E R N , the 
quantity C^fi T (q, h l , h?) increases monotonically with de- 
creasing e, as well as with decreasing 5. 

As we would expect, the work cost thus increases if 
we demand a lower risk of failure (smaller e), or if we 
require a higher precision in the extraction (smaller 6). 
Note that a direct consequence of the monotonicity of 
C°f T (q,h\h f ) in S is that the limit in Eq. |l2| is well 
defined. 

Definition 8. Let h\h s € R N , q E P(A), and let Af 
be a random variable with distribution q. Let e,i5£R be 
such that < e < 1 and < 6 < +oo. We define the 
(e, 6) -deterministic work content of q relative to h as 



C°f(q,h,h) 



:sup |J A s (-W(V,Af)), (K) 



and the e-deterministic work content as 
A £ (q,h) :=-CT tr {q,h,h). 



Proposition 5. Let ft*, ft/ € R N , and q £ ¥(N). Let 
< e < 1 - and < S < +oo. Then 

F(h f ) - F £ (q, h<) + j ln(l - e) - 65 



<Ctf(q,h\hf) 
< F(h*)-F e (q,h i ). 



(15) 



The proof of Proposition [5] is presented in Appendix [J] 
Note that due to Eq. (|H6|) we have 



F(h f ) - F e (g, h l ) =F(h f ) - F{h l ) 

-kT\n{2)Dl{q\\G{K)), 



(14) 



which puts Eq. (|I5j) in a form more similar to the results 
concerning the expected work extraction in Proposition 

ED 

Corollary 1. Let h E R N , q E F(N), and let Af be a 

random variable with distribution q. Let e,S EM. be such 
that < e < 1 7= , then 

V 2 

< A e (q, h) - F e (q, h) + F(h) < -fcTln(l - e). 

As considered in more detail in Appendix[Kj the quan- 
tity — kT ln(l — e) is the largest e-deterministic work that 
can be extracted from a thermal equilibrium state. 

If we in Corollary [l] take the special case of a com- 
pletely degenerate set of energy levels, we find A e (q, h) w 
kT[\n(N) - H^(q)}. Here H$(q) is a smoothed Renyi 0- 
entropy, defined as H^{q) := min 9 (A.)>i-e 

log 2 |A|. Up to 

technical differences this is essentially the result obtained 
in [9]. Apart from a difference in terms of the choice 
of smoothing, the result in [S] is stated in terms of a 
smoothed Renyi 1/2-entropy, rather than the smoothed 
Renyi 0-entropy we use. However, results in, e.g., |47j 
suggest that these entropies can be substituted at the 
cost of error terms constant in the system size. A per- 
haps more relevant difference is that [3] does not employ 
the same type of cost function as we do here, but rather 
the type of threshold function briefly described in Ap- 
pendix [0} 



Appendix J: Proof of Prop. [5] 

The proof idea of the lower bound in Prop. [5] is to 
decompose the total process into two parts, where the 
first part is the initial LT of the process, and where the 
second part (if any) begins with a thermalization. We 
proceed by finding a lower bound on the work cost for a 
single LT. In Appendix | J 2| we prove a variant of Crook's 
fluctuation theorem to find a similar bound for any pro- 
cess that operates on an equilibrium distribution. In Ap- 
pendix | J 3| we combine these two bounds to obtain the 
lower bound in Eq. ( |T5| ). To obtain the upper bound in 
Prop.[5]we construct a sequence of processes for which the 
e-deterministic work cost converges to the upper bound. 
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1. Lower bound on the work cost of a single LT 

Lemma 10. Let h l ,h' G M. N , and let V be a single LT 
that takes h l to h! . Let M b distributed q G V(N). Let w 
be an (e, 5) -deterministic value ofW(V,N), then 



w^F^-F^q^^-S. 



(Jl) 



Proof. We first note that with probability qj, the the 
work cost of the single LT is h'j — h*. Define A := {j G 
{1,...,N} : m - h) -w\ < 6}. Since w is an (e,5)- 
deterministic value of W^^N) it means, by definition, 
that q(A) > 1 - e. 



F{h')<-\\nY,e- f3h 'i 



jeA 



< 



jeA 



(32) 



=6 + w- ilnYV^S 
<5 + w + F e (q,h l ). 



□ 



2. A variation on Crook's theorem 

Crook's theorem [15] relates the probability distribu- 
tion of the entropy production, or work cost, of a process 
and its reversal. We shall here derive a slight variation of 
Crook's theorem within our model. Since the thermaliza- 
tion in our model is a special case of the detailed balance 
condition, it is maybe not particularly surprising that we 
can derive Crook's theorem. (Note, e.g., that a similar 
type of model, based on detailed balance, was employed 
in [13] to derive the Jarzynski equality [48].) The reason 
for this derivation is more on a technical level; we need 
a particular version that fits well within our framework. 

Given a process V G ¥(h' l ,h^) we define the pro- 
cess V ICV G ¥(hf,h z ) as the reversal of the sequence 
of thermalizations and LTs in V . To be more pre- 
cise, let V is a sequence of alternating thermalizations 
and LTs along a sequence of energy level configurations 
(h°,h 1 ,...,h L - 1 ,h L ), with h° := h l and h L := h f . 
Then V lev is the sequence of alternating thermaliza- 
tions and LTs along the sequence (h TCV -°, h™'^ 1 ) := 
(h L , h L ~\ h\h°). Hence h ICV ' 1 = h L ~ l . 

In the following Lemma we assume that the forward 
process V operates on an initial state M % that is Gibbs 
distributed G(h l ). Similarly, the reversed process "P rcv 
operates on the initial state J\f\ which has the Gibbs 
distribution G(h^). Note that Af* should not be confused 
with the final state J : ('P,N' 1 ). These are not necessarily 
equal, and may not have the same distribution (unless 
V ends with a thermalization) . Similarly, J r ('P rov , J\f') 
does not necessarily have to have the same distribution 
as TV*. 



Lemma 11. Let h\h s G R N , let V G 0>(h\hf), and 
6 > 0. Denote AF := F(h*) - F(ti). Then, for all 

we!, 



(w-AF) e -06 < 



P(\W(P,AT i 



<5) 



P(\W(V rev ,Af f ) + w\ < 5) 

where J\f l is distributed G(h l ), and J\[f is distributed 
G(hf). 

Proof. Consider a specific path n := (no, . . . , Kl-i) G 
{1, . . . , N} xL of the forward process V , i.e., initially the 
system is in state no, next in state n%, etc. The work cost 
of this path is u% :— Yld=o C 1 ™ 1 ~ Ku ) • Analogously, the 
work cost of a path m = (mo, . . . , tol-i) G {1, . . . , N} xL 
of the reversed process "P rcv is 



U't, 



(J3) 



let us now define the operation rev(n); := n^-i-i, for 
I = 0, . . . , L — 1, which is a bijection on {1, ... , N} xL . 
With these definitions, one can check that 



(J4) 



Let us again consider the work cost w% of the path n of 
the forward process. By using Eq. ( Dll[ ) it follows that 



i % =F{h L ) - F(h°) - - \nIl^ 1 G ni (h l+1 ) 



\nU^G ni (h l ). 



(3b) 



Furthermore, the probability to get path n in the for- 
ward process V is P(n) := Tl^T^Gn, (h l ). Hence, we can 
rewrite Eq. OBI as 



P(n) = AF) Hf =0 1 G„ ! (h' +1 ). (36) 

Let us define the set of paths 



A:={n€{l,...,N}> 



<S}- 



(37) 



In other words, A consists of those paths for which the 
work cost of the forward process differs at most S from 
w. Hence, using Eq. (J6), this results in 



P(\W(T,Af l ) - w\ < 5) 

= E p w 



neA 



(38) 



= J2 e " (WW ' AF)U ^oGn l (h l+1 ). 



neA 



Utilizing the defining condition in Eq. [37), i.e., w — S < 
Wn < w + S, yields the inequalities 

e P( w -AF-6) < P(\W(V,N i )-w\<5) 

- ZneA^G^h^) ( J9 ) 

<e (3(w-AF+S)^ 
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Let us now define the set B of paths such the reversed 
process V Tev gives a work cost that differs at most 8 from 
—w. 



B-.= {me {1,...,N} 



< L :\w^ + w\<5}. (J10) 



By Eq. ( |J4[ ) and the fact that n h-> rev(n) is a bijection 
it follows that rev(-B) = A. 

The probability of a path fn of the reversed process 



is 



V^(m) =n^G mi (h L - 1 ) 



(Jll) 



(Note that V rcv (m) ^ 7>(rev(m)).) 

By construction of the set B, we can conclude that 

P(\W(V mv ,Af f )+w\ <8) 



Inserting the above equation into Eq. ( J9 1 yields the 
statement of the lemma. □ 

Corollary 2. Let h\h f £ R N , let V £ ^(h\h^), and 
let e, (5 be real numbers such that < e < 1 and < 8. If 
Af is distributed G{K l ) then 

mtA e s (W(V,JV)) > i ln(l - e) + F{h f ) - F{h l ) - 8. 



3. Proof of the lower bound in Eq. (15) 



Proof. Without loss of generality the process V can be 
regarded as an alternating sequence of LT processes and 
thermalizations, beginning with an LT that takes h l to 
some configuration of energy levels h'. (We can let 
h! = h\) We let denote this initial LT of the process. 
Next, the system is thermalized, and the remaining part 
of the process is denoted V {2) . The process begins in 
the state Af' which is distributed G(h'). Since V 1 - 1 " 1 and 
V 1 ^ are separated by a thermalization, it follows that 
WiV^M*) an d W{V [2 \Af') are independent. Further- 
more, by assumption < e < 1 — l/\/2, and < 8. 
Hence, by Lemma [6] we find that 

MA'eiWiV,^*)) >mfAf(W(pW,^)) 

+ MA e s (W(V {2 \M')) -48. 
We know from Lemma [TUl that 

MAftWiV&KN*)) > F(h') - F e (q,h l ) - 8. 

Since starts in the Gibbs distribution G(h'), Corol- 
lary [2] yields 

infAf (W(;P( 2 ),A0) > 4 ln(l - e) + F(h f ) - F(h') - 8. 



Combining the above inequalities yields the lower bound 
in Eq. pBl. □ 



4. Proof of the upper bound in Eq. (I5| 



To prove the upper bound in Proposition [5] we shall 
here construct an explicit family of processes whose (e, 8)- 
deterministic work values approach the bound. 

However, shall first prove a lemma. In the proof of this 
lemma make use of Lemma [l] which can be rephrased 
as asserting the existence of a process V £ ^(h l ,h^), 
such that F(h f ) - F(^) is an (e, <5)-deterministic value 
of W(V,Af), where Af is distributed G{h l ). 



Lemma 12. Let h l ,h* £ M. N and let e, 8, and £ be real 
numbers such that < e < 1, < 8, and < £ < 1. 
Let Af 1 have the distribution q £ F(N). Then there exists 
a V £ £P(h l ,hf) and a w £ K., such that w is an an 
(e, 8) -deterministic value of W(V, Af' 1 ), and 



<£ + F(h f )- F%q,h l ). 



(J12) 



Proof. As noted in Appendix [H] there exists a A* C 



jGA* 



{1, . . . , N} such that F e (q,h l ) 

Due to the strict inequality, q(A*) > 1 — e, there exists 
a number 1 > r > such that q(A*) > rq(A*) > 1 - e. 
We construct a process V as a concatenation of a process 
a thermalization, and a process V^ 2 \ Let E £ R, 
and let be the LT that takes h l to the new configu- 
ration of energy levels h' , defined by 



hi if he A* 
h{ + E if k £ A* 



(J13) 



As seen, W^WjJV*) takes the value with probability 
q(A*). Next we thermalize the system, thus putting it in 
a state Af' distributed G(h'). 

By Lemma [T] we know that there exists a process 
£ &>(h',h f ), such that F(hf) - F(h') is an 
(1 — r, <5)-deterministic value of W(V^ 2 \ Af'). Since 
W(V (1 \Af l ) and W(V {2 \Af') are independent it follows 
that P{\W{V^\N l ) + W{V^,Af') - F{hJ) + F{h')\ < 
8) > q(A*)r > 1 - e. Hence, w = F(h f ) - F(h') is an 
(e, ^-deterministic value of W(V,N l ). Note that F(h') 
is a monotonically increasing function in increasing E, 
and lim£_j. +00 F(h') = F e (q,h l ). Hence, for each £ > 
there exists an E such that -F(h') < £ - F € (q, h l ). For 
such a choice of E, the corresponding process V thus 
have w = F{hf) — F(h') as an (e, ^-deter minis tic value 
of W(V,Af l ), which moreover satisfies Eq. (J12|. □ 



Proof of the upper bound in Eq. By Lemma 12 we 

can conclude that there exists a sequence of processes 
V m £ &>(h\hf) and a sequence of real numbers w m , such 
that w m is an (e, (S)-deterministic value of W(V m ,Af), 
and w m < — + F(h*) — F e (q, h l ). This proves the upper 
bound in Eq. (pi □ 
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Appendix K: e-deterministic work extraction from 
thermal equilibrium 

Let h £ R N . A direct consequence of Corollary [2] is 
that 



A e (G(h),h) < -fcTln(l-e). 



(Kl) 



In other words — fcTln(l — e) is an upper bound to the 
e-deterministic work content of a system that is in equi- 
librium with a heat bath of temperature T. (Note that 
Eq. ( |K1[ ) implies that the upper bound in Corollary [I] is 
not sharp for all initial distributions and configurations of 
energy levels.) Corollary [l] furthermore provides a lower 
bound: 



A € (G(h),h) > 



-fcTln inf 

G A (fc)>l- 



G A (h). 



This lower bound implies that with suitable configura- 
tions of energy levels h we can extract e-deterministic 



work arbitrarily close to the upper bound in Eq. (Kl| 



(For example, if we let one energy level, 1 say, be suffi- 
ciently much lower in energy than all others, we can have 
Gi(h) > 1 — e with G\(h) arbitrarily close to 1 — e.) 

Note that the above statement can be rephrased as the 
probability of success of the extraction being exponen- 
tially small in the extracted energy. This is in agreement 
with the standard fluctuation theorems, where thermal 
fluctuations can violate the macroscopic notion of the 
second law, but with a probability that is exponentially 
small in the size of the violation [S]. 

From Appendix [D] we know that the expected work 
content of the equilibrium is zero. Hence, the gain in 
the successful case in the e-deterministic work extraction 
has to be compensated by a corresponding loss in the 
unsuccessful case. (In the specific process used in the 



proof of Lemma 12 the cost of failure approaches infinity.) 



Appendix L: Optimal e-deterministic work cost of 
erasure 

Like for the expected erasure cost in Appendix|EJ we do 
not require the erasure process to establish the selected 
state s perfectly, but rather allow an error that in the 
end is taken to zero. 

Definition 9. Let h l ,h^ £ R N , let Af be a random vari- 
able with distribution q £ ¥(N), and let s £ {1, . . . , N}. 
Let e,if £ i be such that < e < 1 and < 8 < +00. 
Define the (e, S) -deterministic work cost of erasure as 



lim inf 

T^0 + 



u 



A< s (W(V,Af)) 
= lim inf mm\(W(V,N)), 



(LI) 



and the e-deterministic work cost of erasure as 

Cr s °(q, h\ hf,s) := lim C c J sc (q, h\ h^s). (L2) 

Analogously as for the definition of the expected 
work cost of erasure, Def. [3] in Appendix [EJ the quan- 
tity inf [J Vf -^, T ( q ih i >h f) Al(W(V, Af)) increases monoton- 
ically with decreasing r. Hence, the limit r — > in 
Eq. (LI) is well defined. 

By direct consequence of Eq. ( |G2[ ) in Lemma [2] and 
Eq. (G4) in Lemma [3] it follows that, for a fixed r, 
the quantity inf \Jve&>- r (q,h i ,hf) A e s (W(P, Af)) decreases 
monotonically with increasing e, as well as with increas- 
ing 5. This remains true in the limit r — > 0. We can thus 
conclude: 



(K2) Lemma 13. For fixed q £ P(N), h\tf £ 



sN 



and 

s £ {l,...,N} the quantity C° r J lsc (<7, h % , h* , s) increases 
monotonically with decreasing e, as well as with decreas- 
ing S. 



">crasc 

:,<5 



(g, h 1 , h* , s) with re- 



Due to the monotonicity of C\ 
spcct to S, the limit 6 — > in Eq. (|L2|) is well defined. 



Proposition 6. Let h l ,hf £ 
0<e<l-^,0<5< +00, 



1 



l N , and let q £ P(N). Let 
and s £ {1, . . . , N}. Then 



h{ - F^(h l ) + -Ml - e) 

<Cff c {q,h\hf lS ) 
<h{-F*(h l ). 



(L3) 



As a special case of Proposition [6] it follows that the 
e-deterministic work cost of erasure for the case of a com- 
pletely degenerate set of energy levels h :— h' — h % is 
bounded as fcTln(l-e) < Cf asc (g, h, h, s)-kTH^(q) < 0. 



Appendix M: Proof of Proposition [6] 

The proof idea of the lower bound in Proposition [6] is 
to divide the total erasure process into two parts. The 
first part is almost the entire process apart from the very 
last LT. For the first part we can apply our results on 
work extraction in Proposition [5] to find a bound on the 
work cost. We next observe that the very last LT is 
very constrained by the requirement that the system with 
high probability should put in state s. This leads to a 
bound on the work cost. To prove the upper bound in 
Proposition [6] we define a specific sequence of processes 
for which the e-deterministic erasure cost converge to the 
upper bound in Proposition [6] 



1. Proof of the lower bound in Eq. (L3) 



Lemma 14. Let h l ,h^ £ M. N , letAf be a random variable 
distributed q £ F(N), and let s £ {!,... ,N}. Let < 
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t < e < 1 — A= , and < <5 < +oo . Then 

MA e s (W(V,Af)) >H - F e (q, h l ) - I 
1 



ln[(l-e)(l-r)] 



(Ml) 



for allV € 0> T s {q,ti,hf). 



Proof. First we note that Eq. (Ml) is trivially true for 
processes V such that inf A e s (W(V), N) = +oo. Hence, 
without loss of generality we may in the following restrict 
to processes V is such that inf A e s (W(V), J\f) < +oo. 
Since V can be regarded as an alternating sequence of 
LTs and thermalizations, we can distinguish two cases: V 
contains no thermalization, and thus effectively consists 
only of a single LT, or V contains at least one thermal- 
ization. 

In the first case V consists only of a single LT. Hence, 
this LT must transform h l to . Since an LT does not 
change the distribution of the state, we must have q s > 
1 — r. Since r < e < 1 — 1/V2 < 1/2 it means that q s > 
1/2. Hence, any subset A C {1,,.,,N}, with q(A) > 
1 — e > 1/2 must contain s. Moreover, since r < e 
implies q s > 1 — r > 1 — e, it is enough if A = {s} for 
q(A) > 1— e to hold. One can thus realize that F £ (q, h % ) — 



In inf, 



9(A)>1- 



E 



|3 ' 1 " = hi. Furthermore, since 



q s >l — r>l — e> 1/2, it follows that h{ — h\ is an 
(e, 5)-deterministic value of W{V). By Lemma[4j we thus 
have h( - h\ -2S< mfA e t(W(V),Af). We can conclude 
that the inequality in Eq. (Ml) is satisfied. 



The second case is that the process contains at least 
one thermalization. We may thus decompose V into two 
parts. The first part, is the entire process up to 

(and including) the last thermalization. This thermal- 
ization is done with respect to some set of energy lev- 
els h' and leads to the state A/"', which is distributed 
G(h'). The second part, V^ 2 \ consists only of a sin- 
gle LT that takes h' to . Due to the thermaliza- 
tion at the end of V (1) , it follows that W(V {1 \N) and 
W(VW,Af') are independent. Since inf A e s (W(V {1) + 
W(VW JM')) < +oo, by assumption, it follows by 
Lemma[5]that MA e s (W(V {1) ,JV)) < +oo. Hence, there 
exists a w £ f such that 



P{\W{V {1 \N) -w\<5)>l-e. 



(M2) 



Let us now consider the process V^ 2 '. Since V € 
Z^siq, h?, h*) it follows that h' must be such that 
G s {h') > 1 — r, which we can rewrite as 



h> s <--\n(l-T) + F(h>) 



Note that due to the assumption r > there exists a 
h' E l w that satisfies this condition. 

Furthermore, P{W{V {2 \W) = h{ - h' s ) > 1 - r. By 
combining this observation with Eq. ( M2 ) we find (using 



the independence of W{V {1 \Af) and W(V {2) ,N')) that 

P{\W{V,M) -w-h(+h' s \<6) 
>P(\W{V {1 \N) -w\< 5)P{W{V {2 \N') =h{- h' s ) 
>(l-e)(l-r). 

The conditions 0<r<e<l — l/y/2 implies < e + 
r — er < 1/2. This enables us to apply Lemma [4] to the 
above inequality, with the result 



hi - h' -2S< inf A 



e+r— er 



(W(V),Af). (M4) 



Since e + r — er > e it follows by Lemma [2] that 

w + h{ -h' s -2S <mfA e s (W(V,N)). (M5) 

Since w is an (e, (5)-deterministic value of W^^, A/") we 
can conclude that MA%(W{V^\j^)) < w. Since e < 
1 — 1/V2, Proposition yields 

MAI(W(V,M)) >h{ - F%q, h l ) - h' s 

+ F(h') + * ln(l - e) - 8.5. 

P 



By combining this with Eq. (M3) we find Eq. (Ml). □ 



Proof of the lower hound in Eq. JXjf) . The lower bound 
in Eq. ( L3 ) follows from Lemma ^14] if we first take the 
infimum over all processes in &l(q, h z ,hf), then take the 
limit t — !• 0. □ 



2. Proof of the upper bound in Eq. (L3| 



Lemma 15. Let h % ,h* € R™, let Af be a random variable 
with distribution q € V(N), and let s € {1, . . . , A^}. Let 
< t < e < 1, < 5 < +00, < £ < 1. Then there 
exists a V € ^J(q, h l , h/) and !«eR such that w is an 
(e, 5) -deterministic value ofW(V,Af), and 



<e + /i{ + -ln(l-r) 
- F^~ T ^^- T Hq,h l ). 



(M6) 



Proof. We construct V as a concatenation of a process 
pW, a thermalization, and a process 

We begin by constructing the process For a given 

real number E, define h' s :—h{ — E and h' n :— h^ for all 
n 7^ s. Let us choose 



TLy^S 



(M3) This choice yields G s (h') = 1 - r and 



F(h') = -E + h*+pHl-T) 



(M7) 



(M8) 



Define e := (e — t)/(1 — r). By the assumptions on e 



and t it follows that < e < 1. By Lemma 12 we thus 
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know that there exist a process £ V(h l ,h') and an 
(e, <5)-deterministic value of W(P^\ Af) such that 



(1) <^ + F(h')-F e (q,h i 



(M9) 



to an analogous quantity. Given a random variable X 
with distribution q € P(iV), the relative Shannon entropy 
between q and another distribution r G P(iV) can be ex- 
pressed as D(q\\r) = (log 2 [q(X)/r(X)]), i.e., as an expec- 
tation value of the random variable \og 2 [q(X) /r(X)]. In 
an analogous manner we define the standard deviation of 
the random variable log 2 [q(X)/r(X)] as 



a(q\\r) 



\ 



We next turn to the process P^ 2 \ and let it be the LT 
that takes ft' to ft/. For this process W(P {2 \N') = 
hj^,~h'j^, — ES S ._\T', where AT' is Gibbs distributed G(h'). 
Furthermore, P(W(T (2) ,Af r ) = E) = G s (h') = 1 - r. 

Let the total process V be a concatenation of 
followed by a thermalization, and the process . Due 
to the thermalization, W{P {1 \N) and W(V^\Af') are 
independent, and thus P(\W(P,Af) - - E\ < 6) > By combining Eqs. (|F6| and (InTI) we find that 
P(\W(P^,Af)-w^\ < 5)P{W{P i - 2 \W) =E) > 1-e. 
Hence, w :— u/ 1 -* + E is an (e, <5)-deterministic value of 
W(V,Af). By combining this with the inequalities in 
Eqs. (|M8|) and ( M9 ) we find the statement of the Lemma. 




r(X)/ 



a(VF yicld ) = ATln(2)«7(g||G(/i)). 



(N2) 



(N3) 



□ 

Proof of the upper bound in Eq. |X3| ). Let £ m :— 1/m 
and let r m :— e/m for each m g N with to > 2. By 
Lemma [15] we know that for each m there exists a pro- 
cess V m G £? r s m {q,h % ,W ) and w m € K such that w m is 
an (e, <5)-deterministic value of W(P m ,N), and satisfies 
the inequality 



<- 



1 



hi 



I m (i--) 

p to 



F 



e(l-m _1 )/(l-£m _1 ) 



(M10) 



Note that e(l 



L )/(l 



L ) increases monotoni- 



cally to e for increasing to. Hence, by the left-continuity 
of F e with respect to e, Lemma [8] it follows that 
lim m ^oo F e ( 1 - m ~ 1 )/( 1 - em ~ 1 )( q i ft') = F e (q,h l ). Thus, 
the right hand side of Eq. ( |M10| conve rges to ft{ — 
F e (q,h 1 ), which is the upper bound of Eq. ( L3 ) . Further- 
more r m goes to zero as to increases, which thus proves 
the upper bound of Eq. ( L3 ) . □ 



Appendix N: Comparisons 

Here we compare the expected work extraction with 
the e-deterministic work extraction for some simple ex- 
amples. For the sake of simplicity we focus on the work 
yield quantities A(q, ft) and A e (q, ft), rather than the 
more general work cost quantities C extr (q, ft 4 , ft/) and 
C| xtr (q, h l , ft/). We will furthermore consider the the 
fluctuations (as described in Appendix |F| in the opti- 
mal expected work extraction. To quantify the size of 
these fluctuations we use the standard deviation of the 
work yie ld variable W yic id := W y i e id(h,Af) as defined by 
Eq. ( F6 ) . In other words, we measure the size of the 



fluctuation by 



^(W yield ) := vV y 2 icld } - (W yicld ) 2 . (Nl) 

Similarly as A(q, ft) is directly related to the relative 
Shannon entropy, the quantity o/Wyieid) can be related 



In the following we shall compare how A(q, ft), 
o^Wyieid), and A e (q, ft) scale with the system size. For 
this purpose we will in the following consider systems 
that consist of to 'units' of some type (qubits, spins, 
etc). For each number to we shall have a initial dis- 
tribution q m and a collection of energy levels ft m . We 
compare the three quantities A(q m ,h m ), cr(W^ cld ), and 
A e (q m , ft™ 1 ), in terms of their scalings in to. (Define 
^yicid '■— WyieidC?" 1 , ft" 1 ).) More precisely, we compare 
the leading order terms of these quantities in the limit of 
large m. 

For these comparisons we use the asymptotic equiv- 
alence. Two functions /(to) and g(m) are asymptot- 
ically equivalent (with respect to to — >• +oo) denoted 
/(to) — g(m), if lim m _y +00 [/(m)/p(m)] = 1. This means 
that / and g have the same leading order. 

We will also make use of an expansion up to the next to 
leading order in increasing to. Let c\ and c\ be constants, 
and <7i and g 2 functions such that g 2 — o(g\) (where 
the latter means that lim m ^ +00 [g 2 (m) / gi(m)] — 0), and 
suppose that 



/(m) = ci5i(to) + c 2 g 2 (m) + o(g 2 (m)). 



(N4) 



Then we say that we have a next to leading order ex- 
pansion of /. In our case we will use gi(m) '■= to and 
52 (wi) := \frn~- (For a more general introduction to the 
notion of asymptotic expansions, see e.g. |49j.) 



1. Independent, identical, and non-interacting 

systems 

We begin with an example where the fluctuations in 
the expected work extraction in some sense are small. 

Consider to copies of a system. These copies are in- 
dependent and identical both in terms of their state 
distributions as well as their Hamiltonians. More pre- 
cisely, we assume that the distribution q m of the to- 
tality of the m systems is a product distribution, i.e., 
Ql^ ... i = Qh' • • Ql m i f° r some single-system distribution 
q. We will denote this TO-fold product distribution as 
q®m_ furthermore assume that the systems do not 
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interact, and that all of them have the same Hamilto- 
nian. In terms of our model, this means that set of 
energy levels h m for the total system can be written 



"h,—,l„ 



= h h 



for some single-system set 



of energy levels h. Wc denote this m-fold direct sum by 
h® m . Note that the Gibbs distribution corresponding to 
such a collection of identical non-interacting Hamiltoni- 
ans is a product distribution, G(h® m ) = G(h)® m . 

Due to the additivity of the relative Shannon entropy, 
the expected work content is 



A(q® m ,ti 3m )=mkThi{2)D{q\\G(h)). 



(N5) 



Hence, the expected work content grows proportionally 
to the system size m. 

Next, we determine the size of the fluctuations in 
the expected work extraction in terms of the quantity 
a(W^ cld ). By using the fact that 



o-(q a qb\\r a rb) 2 = c(g ||r a ) 2 + <T(q b \\r b ) 2 , 
one finds 



(N6) 



o{W™ M ) = V^kTH2)a(q\\G(h)). (N7) 

Hence, as anticipated, the fluctuations only grow at the 
order of y/m. 

We furthermore wish to determine how A e (q® m , h® m ) 
scales with m. For sufficiently small e we know from 
Corollary [T] that this reduces to the question of how 
Dl(q® m \\G(K)® m ) scales with m. In Proposition [7] (in 
Appendix N 2 below) we determine the next to leading 
order of the latter quantity, which yields 



--mkT\n{2)D{q\\G(h)) 
+ ^TikTln(2)<p- 1 (e)a(q\\G(h)) 
+ o(y/m). 



A e (q* 



Here 4> _1 denotes the inverse of the cumulative dis- 
tribution function of the standard normal distribution 
Q(x) :— ^ 00 <^ x ^ 2 dx/-\/2n. Hence, to the leading or- 
der, the e-deterministic work content is the same as the 
expected work content. The difference only shows up at 
the next to leading order, where the work yield is lowered 
by v ^kT\n(2)<p- 1 {e)a(q\\G(h)). Note that ^(e) < 
for e < 1/2, and <5 _1 (e) — > — oo for e — > 0. 



is called relative entropy typical if D(q\\r) — e < 
\og 2 [q(n 1 )---q(n m )/r(ni)---r(n m )] < D(q\\r) + e. One 
can attempt to determine the expansion using this con- 
struction. Properties 2 and 3 in Theorem 11.8.2 in [T5] 
yields the upper bound, and Lemma 11.8.1 in [16] the 
lower bound in 

nD(q\\r) - ne <D%(q® n \\r® n ) 

< - log 2 (l - 2e) + nD{q\\r) + nt. 



With these bounds one can prove that 
lime^olim^ooiDa^lk ") - D(q\\r). How- 
ever, they are not strong enough to show that 
Dl(q® n \\r® n ) ~ nD{q\\r) for fixed e. As a second 
attempt, one can construct two sets of sequences (the 
ones in Def. 10) that are related to the central limit 
theorem rather than the law of large numbers. Via 
the central limit theorem one can use these two sets 
to prove that the leading order in the expansion is 
DQ{q® n \\r® n ) ~ nD{q\\r). However, since this is not 
quite enough for our purposes we will not consider this 
proof here. To obtain also the next to leading order in 
the expansion, we take one step further, so to speak, 
and use Berry-Esseen's theorem, which bounds the rate 
of convergence in the central limit theorem. 

We let $(?/) :— e~ x2 / 2 / Vzirdx denote the cumu- 
lative distribution function of the standard normal dis- 
tribution. Due to Berry [23J and Esseen [21] we know the 
following: 

Theorem 1 (Berry-Esseen) . Let Y\,.,., Y m be iid ran- 
dom variables such that p := (Y) exists, a 2 :— (Y 2 



ft 



exists, with a > 0, and p := (\Y — fi\ 3 ) < +oo. Then, 



i — i m 
,/Vmvl ^ 

I it Lm^ 



Y, 



< y) - ®{y) 



< 



c P 



for all y G 



Note that C is a positive constant, independent of y 
and independent of the distribution of Y , The exact 
value of this constant is to date not known, but there 
exist bounds [SD] (see also, e.g., chapter 7 in [M]). 

Given a random variable X with distribution q, and 
given another distribution r, we define (analogous to 
cr(q\\r) in Eq. (N2)) the quantity 



2. A next to leading order AEP for Df } 

Here we determine the asymptotic expansion in m of 
Dg(q tg,m \\r tg ' m ) up to the next to leading order. 

In classical information theory the concept of rel- 
ative entropy typical sequences is introduced. This 
concept stems from the asymptotic equipartition prop- 
erty |16j . which in turn essentially is an application 
of the law of large numbers. As described in [TB] 
Sec. 11.8, a sequence (m,...,n m ) G {!,..., N} xm 



p{q\\r) := 



q(X) I q(X) 
lo S2 ~ { !og 2 



r(X) 



r(X) 



The following definition specifies two sets of sequences 
that take the role of the set of typical sequences described 
above. Note though, that in the way we will use these 
two sets, only one of them will correspond to typical se- 
quences, while the other set actually will correspond to 
very atypical sequences. 
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Definition 10. Let q £ ¥(N) and r S F+(N) be such 
that a(q\\r) > 0. For m £ N+ and x £ M define 



K :^{(n 1 ,...,n m )e{l,...,Nr m : 

2 x<t v ^+™ AI < g_M . . . g("m) 1 

r(n x ) r(n m )r 



(N8) 



where p := D(q\\r) and a := a(q\\r). We furthermore 
denote the complementary set as 



A: :={l,...,7V} xm \A™ 

= {(n 1 ,...,n m )e{l,...,7V} xm : 

r(m) r{n m ) ~ /' 



(N9) 



A direct application of Berry-Esseen's inequality, with 
the choice Yi — log 2 [q(Xi) /r(Xi)], with Xi iid distributed 
q, yields 

Lemma 16. Let q £ ¥(N) and r £ ¥ + (N) be such that 
a(q\\r)>0. Letm£N+. Then 



|<f m (A™)-l + $(y)| 



< 



Cp 



a 3 y/m' 



(Nil) 



where p :— D(q\\r), a :— a{q\\r), and p :— p(q\\r). 

The general aim of this section is to prove the 
next to leading order expansion of D§(<z 



as m 



Eqs. (N18l a nd JN19 >. The proof is split into three parts: 
Lemmas |17| |18[ and Proposition [7] The general idea 
is to construct sequences of upper and lower bounds to 
Dl{q® m \\r® m ). The lower bounds will be obtained from 
a sequence of sets A™ (m) such that <7® m (A™ (m) ) > 1-e. In 



other words A^ m ) is sufficiently likely with resect to q - 



and thus DQ(q\\r) = — log 2 inf , 
-log 2 



9 ®™(n)>i- 



„<8>m 



(fi) 



> 



2 (A™). Furthermore, the sequence is such that 
g® m (A™( m )) -» 1 - e, and A™( m) thus becomes a set of 
typical sequences for small e. 

Concerning the upper bounds we note that the defi- 
nition Dl(q\\r) = -log 2 inf ? « m(n)>1 _ e r' 8, " l (^) suggests 
that a method to obtain an upper bound is to search 
among sets fl' with g® m (f2') < 1— e, i.e., among less likely 
sets. As it so happens, we achieve the upper bound via 
a sequence of very atypical sets A^.^ in the sense that 

^ m (A: (m) )^ e . 

As a side remark we note that for similar proofs for the 
smooth conditional max-entropy (albeit in the quantum 
case) [51] an upper bound can be obtained quite simply 
via Fannes' inequality |52) . There is indeed an analogue 
of Fannes' inequality for the relative Shannon entropy. 
However, the resulting upper bound appears not to be 
strong enough to establish the next to leading order ex- 
pansion coefficient. This is the reason why we rather use 
the sets A x(m) . 



Lemma 17. Let q G F(N) and r £ V+(N) be such that 
a(q\\r) > 0, and let 1 > e > 0. Then 



£>o(<? Ik ) > mD(q\\r)+y<Ty/m (N12) 

Cp 



log 2 



1 - $(y) 



for all pairs i/£K,m£ N + such that 
Cp 



e > 



(N13) 



where a :— o-{q\\r) and p :— p(q\\r). 

Proof. Let m € N + and y £ K. By the defining properties 



of the set A™ in Def. 
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it follows that 



<2 



l - <%) 



c P 



Vy £ K (N10) that e > 



where the second inequality is due to Eq. (|N10|) in Lemma 

;h 
it 



16 Let us now restrict the pair m S N + and y £ R such 
<&(y). By Eq. (NIOl in Lemma 



Cp 



follows that 



1G 



q® m {IC) > 1 - <%) 



Hence, we can conclude that 



Cp 



> 1-e. 



(N14) 



inf r® m (n) < r® m (A"M. 
n :g » m (fi)>i-€ J 

Since 1 — $(y) H — £7= > the statement of the lemma 
follows. □ 

Lemma 18. Let q £ P(AT) and r £ P+(AT) be such that 
a(q\\r) > 0, and let 1 > e > 0. Then 



£>o(? Ik ) < m£>(g||r) + Wm (N15) 

Cp 



log 2 



$(x) - e 



a 3 yjm 



for all pairs x £ R,m £ N + such that 

$(x)>£+- 

where a :— cr(q\\r) and p :— p(q\\r). 



(N16) 



The proof is similar in spirit to the proof of Lemma 
11.8.1 in [TB]. 

Proof. Let fl C {1, . . , N}® m be such that g® m (0) > 



1-e. By Eq. (|Nll|) in Lemma 

«°-0C) > *(*) - ^ 
N + . Consequently 



1G 



the set A„, satisfies 



'(OnA^) >$(*)-£ 



, for all pairs x € K and m £ 
Cp 



(N17) 
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By^ combining this with the defining condition for the set 
A„ it follows that 



r® m (ft) > r 8m (!lnA™) 

> 2- 1I V s -""' 9 » m ((inyC) 



^ Q—xo^frn—m^ 



Cp 



Cp 



where p = D(q\\r). Assuming <$>(%) > e 
take the logarithm of both sides of the above inequality, 
and obtain the bound in Eq. ( N15 ) by taking the infimum 



of log 2 r® m (fi) over all 0, such that g® m (ft) > 1 - e. □ 

Proposition 7. Let q G ¥(N) and r G ¥+(N), and let 
1 > e > 0. Then 



lim 

m— f oo 



£><=( g ®m|| r S 



D( 9 ||r) 



(N18) 



and 



lim 

m— ^oo 



m-D(g||r) 



^-^eMgllr) 



(N19) 



Eqs. (N18l and (N19) implies that we have obtained 



the next to leading order expansion 



£>o(? Ik ) =mD{q\\r) + Vm* _1 (e)<r(g||r) 



+ o{\frn) 



(N20) 



Proof. We separate the two cases cr(g||?-) = and 
a(q\\r)^0. 

Case cr(g||r) = 0: We first make a general observation 
concerning the properties of a and D. Given q' G F(N) 
and r' G F+(N) it follows that o-(q'\\r') = if and only if 
there is a constant 1 > c > such that r' n = cq' n , for all 
n in the support of q' . In this case it furthermore follows 
that D(q'\\r') = -log 2 c, and D{q'\\r') < D e (q'\\r') < 
D{q'\\r') - log 2 (l - e). Since a (q® m \r® m )' 1 = ma(q\\r) 2 , 
it follows that a(q\\r) = if and only if a {q® m \\r® m ) = 
0. By the above comments it follows that mD(q\\r) < 
D^jq^Wr®" 1 ) < mD{q\\r) - log 2 (l - e). This yields 



Eq. (N18). Furthermore, one can see that Eq. (N19) 



holds trivially in this case. 



Case o-(q\\r) ^ 0: Let us choose y in Lemma 17 



as 



y(m) := $ 1 ( t 



Cp 



1 

rn 



Cp 



(N21) 
- i > 

rn 
Cp 



For sufficiently large m we have 1 > e 

0, and v(m) thus well defined. Furthermore, = 

$(y(m)) = e— i < e. Hence, for sufficiently large m the 
conditions of Lemma II 71 are satisfied, and we find 



£>o(9 Ik ) >mD{q\\r) 
-log 2 



1+2- 
m i 



(N22) 



1 

m 



Let us choose x in Lemma [181 as 



af(m):=$ r fe+ „ ^_ + — ^ 
V cr J vm to/ 



For sufficiently large to it is the case that 1 > e - 



(N23) 



c P 

a 3 *Jrn 



> 0. Hence, a; (to) is well defined for sufficiently large 



Cp 



> e 



Cp 



to. Furthermore <&(x(to)) = e + 

Hence, the condition of Lemma [18| is satisfied, and we 
can conclude that 



D*(q® m \\r® m ) <mD(q\\r)+log 2 (m) 



ay/m$ 1 ( e 



Cp 1 



o~°\/m to 



(N24) 



By combining Eqs. (N22) and (N24) one can prove limit 
(|NT8l and 0M. □ 



Note that if Eq. (N10|) is combined with Eq. (|N21|) 



it follows that q (Sm {M^n)) ~> 1 - e - Hen ce 



for small 

e the family of sets A^£ m ) becomes typical. Similarly, 
Eq. \mi\ with Eq. ( |N23[ ) yields <? S)m (A™ (m) ) e. Hence 
the family A^.^ becomes atypical. 

3. A class of state distributions 

As before we consider a collection of to systems, e.g. 



to <i- level systems. For each to we let h m € 



be the 



set of energy levels of the total system. For each m we 
choose a specific state x(m) € {1, . . . , d m }. (This could 
be, e.g., the ground state of h m .) In the following we 
shall assume that h m and a; (to) are chosen such that 



lim G x{m) (h m )=Q. 



(N25) 



Note that this is not a particularly strict condition. 
For example, consider the special case of a collection 
of to non-interacting systems with identical Hamiltoni- 
ans, i.e., h rn = ft,®™, for h G M. d . For a specific element 
s G {1, . . . , d}, we let x(m) := (s, . . . , s), in which case 
G x{m) {h® m ) = G s (ft) m . Since G s (/i) < 1 (due to the fact 
that h G M d ) it follows that \im m ^G x{m) (h Bm ) = 



Hence, in this case, the condition (N25) is always satis- 
fied. (In the followi ng we do not assume h m = h® m , but 
only the condition (N25|.) 

Turning to the initial distribution q m , we let < v < 1 
be independent of to and define 



q?:= {l-v)8 liXim) +vG l {h m ). 



(N26) 



In other words, with probability 1 — v the system is in 
state x(m), and with probability v the system is Gibbs 
distributed. A direct calculation yields 

A(q m , h m ) ~ - (1 - u)^y log 2 G x(m) {h m ), 
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where we have made 
tion lim ro _ J . 00 G x{rn ){h m ) 
limm^co [- log 2 G x(m) (h m )} 
finds 

In 2 



se of the assump- 
= (and hence 
+oo). Similarly, one 



*(W&id) = T °W n \\G{h m )) 



In 2 

T 



\J 1/(1 - v) log 2 G x{m) (ff 



In the special case v — 1/2 we thus find that .4(<7 m , /i m ) 
and a(W^ eld ) scale identically. 

Let us now instead chose v := e for a suf- 
ficiently small e > 0, and compare the above 
with A e (q m ,h m ). By definition D e (q m \\G(h m )) = 
-log 2 min 9m(Am)>1 _ e E/ e A™G / (/i™), where q m (A m ) := 
EieA™ Assuming e < 1/2, the condition q m (A m ) > 
1 — e and the choice v = e implies that x(m) € A™, due 
to the construction of q m . Furthermore, since h m £ M. d 
it follows that G x ( m )(h m ) > 0. Hence, q x ( m ){h m ) = 
1 — e + eG x ( m ){h m ) > 1 — e. We can conclude that jc(m) 
must be an element in A m , and that no other level has 
to be an element. Hence, {x(m)} is the minimizing set, 
and thus D*(q m ,h m ) = -\og 2 G x(m) {h m ). 

Furthermore, due to the relation < A e (q m ,h m ) — 
kT\n(2)D e (q m \\h m ) < -feTln(l - e), it follows that 

A e (q m , h m ) ~ -fcTln(2) log 2 G x{m) (h m ). 



We can obtain the special case mentioned in the main 
text, if we consider a collection of non-interacting iden- 
tical systems, h m = ft,®™, and x(m) = (s,...,s). In 

this case A(q m ,h m ) (1 - e)mkT ln(2) log 2 G s (h), 

^(^yTcid) ~ -mkTln(2)y/^L^ejlog 2 G s (h), and 

A e (q m ,h m ) mfcTln(2)log 2 G s (/i). Hence, a linear 

scaling in m for all three cases. 



Moreover, if we sort the energy levels in a non-decreasing 
order /i m < h™ < • • • , the above minimum is obtained if 
we remove sufficiently many of the levels of lowest energy. 
More precisely, 



D< (q m \\G(h m )) = ^F(h m ) 



!og 2 E 



(N28) 



s=S+l 



where S is the largest integer such that ed m > S. 

To simplify the calculations we will in the follow- 
ing make an assumption on the family of energy levels 
{fr.™}n=i and how they depend on m. Namely, for a suf- 
ficiently well behaved functions g (we will in fact only use 



and e we assume that 



-t & r+oo 

sr£sCO~/ g(x)f^(x)dx 

n=l J -°° 



(N29) 



where f m) (x) > and f m \x)dx = 1. (Or sim- 
ilarly, with modified limits of the summation and inte- 
gration.) In other words, we assume that in the limit of 
large m the collection of energy levels can be replaced 
with a spectral density function. 



Applying this to Eq. (N27l yields 



A{q m ,h r ' 



■)~-m 



e- px f {m) {x)dx, 



^(WyTeld) 



-\-oo 



x 2 f im) {x)dx. 



(N30) 



(N31) 



4. Maximally mixed state distribution 

As before, we consider m d-level systems, but with 
a maximally mixed distribution of its initial state, i.e., 
q™ ; := dr m for alHi, . . . , l m . For the sake of simplic- 
ity, and without loss of generality, we may shift the set of 
energy levels such that JZ Z i h m (li, . . . , l m ) = 0. In 
this case we have 



A{q m , h m ) = - kTm ln(d) - F(h m ), 

v 2 (W% eld )=d- m £ (hr u ..., lm f. 

h,...,l„ 



(N27) 



Since all states are equally likely, the minimization in 
the definition of Dq is much simplified, as the condition 
q m (A) > 1 - e reduces to |A| > (1 - e)d m . As a conse- 
quence 



log 2 



|A|>(l- e )d' 



£< 



Next we consider the e-deterministic work content. If 
we let F^ m \x) — J*^ f( m \x)dx denote the cumulative 
distribution function, then the condition ed m > S can 
be reformulated as e = F^ m '(S). Assuming F {m ^ to be 

invertible we thus find S = F ( - m ^ 1 (e). Hence, Eq. ( N28 ) 
reduces to 

D' (q m \\G(h m )) 

ln ( 2 ) J-oo 

-—In/ e- 0x fW(x)dx. 
ln(2) J F(m) -i (e) 



a. The flat distribution 

As a simple example we consider the case of a flat 
distribution of the energy levels. For a(m) > we define 



J [ ' ' \ \x\ > o(m). 



(N32) 
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With this choice in Eq. ( |N30| ) we find 

A(q m ,h m ) ~ a{m) 



^(W y T e i d ) ~ ^o(m). 



1 



(N33) 



(N34) 



Furthermore, since (e) = (2e - l)a(m) it follows 

that 

D e (q m \\G(h m )) ~2ea(m) + - In (l - e - 2/3 °^ 

- - In (l - e -2/?(l-e)a(m)) . 

For e < 1 — 1/V2 we can now use the fact that < 
A e (q m ,h m ) - kTln(2)D e (q m \\G(h m )) < -fc7Tn(l - e) 
which yields 

A £ {q m ,h m ) ~ 2ea(m). 



b. Wigner distribution 
Let R(m) > and define 



J ^ '■ \ o |x| > i?(m). 

By, e.g., Eq. 9 in Sect. 4.3.3.1 of [53], it fol- 
lows that the above semi-circle law has the variance 
f+™ x 2 f( m \x)dx = R(m) 2 /4. Hence 



(N35) 



Furthermore 



^(g" 1 , ft" 1 ) ~-g In ^(m), 

Mm) =- / e-^ m)v ^/l^dy. 
~x J-i 

We determine upper and lower bounds to this integral, 
which gives us the asymptotic behavior. On the interval 
[-1,1] it is the case that e~ pR ^ y < e^ m \ which yields 
the upper bound h(m) < e^ R(m \ Next, we determine a 
lower bound. To this end we we define the function 



' otherwise. 



(N36) 



We have y/l — y 2 > g(y), for \y\ < 1. Hence 

/l(m) ^ ^^R^ 1 - [1 +m™)\'- mm) )- (N37) 
Combining the upper and lower bound we thus find 

A(q m ,h m ) ~ R(m). (N38) 



Similarly as for A we determine the asymptotic be- 
havior of A e via upper and lower bounds. With F(x) := 
I Hi V 1 - y 2d V> it; follows that F( m )(z) = F(z/R{m)), 
and thus F(" l ) _1 (e) = i?(m) J F 1 ~ 1 (e). We let 

.4 e (<T , ft™ ) ~ i In A (m) - 1 In J 2 (m) 



J 2 (m) 



R(m) 



F("*) -1 (e) 



f^ m '>(x)e~ l3x dx 



and find J 2 (m) < (1 - e^"^™^ 'W. 

We again use the function g to get a lower bound. Note 
that we here assume e < 1/2. 



h(m) > 



2 e -^fl(m)F- 1 (e) 



(3R(m) 



1 



^fl(m)F- 1 (e) 



1 



/3i?(m) (3R{m) 
We can conclude that 

A e (q m ,h m ) ~c(e)i?(m). 



(N39) 



where c(e) := 1 + -F 1 (e). Note that for sufficiently small 
e we have 



2/3 

< I < c(e) < 



/ 3tt V " / :■!;: 

V4^ 



2/3 



(N40) 



Appendix O: Other cost functions? 

In this investigation we have focussed on the expecta- 
tion value and the (e, ^-deterministic value as cost func- 
tions. Clearly one could imagine other constructions. 
Here we briefly point out one particular alternative, re- 
lated to [9]. 

Given a real valued random variable X, we ask for the 
smallest upper bound to X that is violated with proba- 
bility smaller than e. A very likely upper bound, so to 
speak. More precisely 

Max c (A) := infijx : P(X < x) > 1 - e}. (01) 

It is straightforward to see that 

5 + MA e s (X) > Max 6 (A). (02) 

Analogous to C QXtr (q, h\ h f ) and Cf a,T {q, h l , ft/) we can 
use Max 6 as a cost function to define 

MT tr {q,h\h f ):= inf Max e (WCP, AO). 



By Eq. ( 02 ) we can conclude that 

C e oxtr (g, h\ h f ) > MT tx (q, h\ h f ). (03) 

One could speculate whether A4° xtr (q, h l ,h^) has almost 
the same value as C° xtr (q, h l , h*) in general thermody- 
namic models. (Whether they have the same value in 
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the particular model we employ here is not clear.) The 
intuition is that we could 'waste' energy in order to make 
the work cost variable more concentrated. More pre- 
cisely, imagine that we have found a process V such that 
P(W(V, A/") < w) > 1 — e, for some w. Conditioned on 
the case that W < w, i.e., that the work cost is less than 
w, one could imagine to make an additional dissipation 
of size w — W. By this, all the weight of the probabil- 
ity distribution below w is 'shuffled' into a single peak 
at w. This would make w into an e-deterministic value. 
However, this 'wasting of energy' is conditional, i.e., the 
choice of process depends on the actual value of W (as op- 
posed to the processes in this investigation, which do not 
depend on the values of the random work variables per 
sc.) The analysis of such conditional processes would rea- 
sonably entail an explicit modeling of the control mech- 



anisms that implement these conditional processes (re- 
garding the conditional process as an unconditional pro- 
cess on a larger system). In view of Landauer's principle, 
we would not expect the resetting of this control mech- 
anism to come for free. The question is, what does it 
cost us to 'waste' energy? Another way to phrase the 
very same question would be to focus on the system that 
carries the extracted energy (which we do not model ex- 
plicitly in this investigation). The 'shuffling' of the work 
value described above, corresponds to a many-to-one map 
of the states of the energy reservoir, which again is an 
erasure process. Loosely speaking, the question whether 
Mf- tT (q, h\h f ) coincides with C° xtr (g, h\ h?) or not, can 
be rephrased as the question whether the removal of the 
excess energy matches the cost of its own erasure. 
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